Jun 17 03:56:08 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 03:56:08 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 03:56:08 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 03:56:08 devstack cinder-volume[81385]: INFO dbcounter [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Registered counter for database cinder
Jun 17 03:56:08 devstack cinder-volume[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG dbcounter [-] [81385] Writer thread running {{(pid=81385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.rpc [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.rpc [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.volume.manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Determined volume DB was empty at startup.
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG cinder.volume.manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81385) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.volume.manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 17 03:56:09 devstack cinder-volume[81385]: WARNING stevedore.named [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 17 03:56:09 devstack cinder-volume[81385]: WARNING castellan.key_manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 03:56:09 devstack cinder-volume[81385]: WARNING cinder.keymgr.conf_key_mgr [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG cinder.volume.drivers.lvm [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81385) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_concurrency.processutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_concurrency.processutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] CMD "cinder-rtstool verify" returned: 0 in 0.351s {{(pid=81385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.rpc [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.rpc [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 17 03:56:09 devstack cinder-volume[81385]: WARNING stevedore.named [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 17 03:56:09 devstack cinder-volume[81385]: WARNING castellan.key_manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO cinder.volume.manager [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 03:56:09 devstack cinder-volume[81385]: INFO oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Starting 1 workers
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Started child 81555 {{(pid=81385) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Full set of CONF: {{(pid=81385) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 17 03:56:09 devstack cinder-volume[81555]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] ******************************************************************************** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Configuration options gathered from: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] ================================================================================ {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] allow_availability_zone_fallback = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] allow_compression_on_image_upload = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] allowed_direct_url_schemes     = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] api_rate_limit                 = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] auth_strategy                  = keystone {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] az_cache_duration              = 3600 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_availability_zone      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_host                   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_name                   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_stats_polling_interval = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backup_api_class               = cinder.backup.api.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backup_name_template           = backup-%s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:09 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backup_use_same_host           = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backup_use_temp_snapshot       = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] chap_password                  = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] chap_username                  =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_internal_tenant_project_id = e31e24ea8ea14a36bbe24802133522ae {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_internal_tenant_user_id = e326e3eff7fa40418be9d9405e0a3ffe {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cloned_volume_same_az          = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cluster                        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] compression_format             = gzip {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] compute_api_class              = cinder.compute.nova.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] config_dir                     = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] config_source                  = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] control_exchange               = openstack {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] debug                          = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] default_availability_zone      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] default_group_type             = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack sudo[81559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 17 03:56:10 devstack cinder-volume[81555]: INFO cinder.volume.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 17 03:56:10 devstack sudo[81559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] default_volume_type            = lvmdriver-1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] disk_geometry                  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_client_cert             = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_client_cert_key         = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_data_namespace          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_ssl_cert_path           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_ssl_cert_verify         = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] driver_use_ssl                 = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] enable_force_upload            = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] enable_new_services            = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] enable_unsupported_driver      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] enforce_multipath_for_image_xfer = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] filter_function                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_api_insecure            = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_api_servers             = ['http://192.168.122.252/image'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_api_ssl_compression     = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_ca_certificates_file    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_catalog_info            = image:glance:publicURL {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_certfile                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_keyfile                 = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_num_retries             = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance_request_timeout         = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] goodness_function              = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] graceful_shutdown_timeout      = 5 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] group_api_class                = cinder.group.api.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] host                           = devstack {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_compress_on_upload       = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_conversion_address_space_limit = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_conversion_cpu_limit     = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_conversion_disable       = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_upload_use_cinder_backend = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_upload_use_internal_tenant = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_volume_cache_enabled     = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_volume_cache_max_count   = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] image_volume_cache_max_size_gb = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] init_host_max_objects_retrieval = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] instance_format                = [instance: %(uuid)s]  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iscsi_target_flags             =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iscsi_write_cache              = on {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iser_helper                    = tgtadm {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iser_ip_address                = 192.168.122.252 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iser_port                      = 3260 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_color                      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_config_append              = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_dir                        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_file                       = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_options                    = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_rotate_interval            = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_rotate_interval_type       = days {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] log_rotation_type              = none {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] max_age                        = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] max_logfile_count              = 30 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] max_logfile_size_mb            = 200 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] max_over_subscription_ratio    = 20.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] message_reap_interval          = 86400 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] message_ttl                    = 2592000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] migration_create_volume_timeout_secs = 300 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] monkey_patch                   = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] monkey_patch_modules           = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] my_ip                          = 192.168.122.252 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] no_snapshot_gb_quota           = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] num_iser_scan_tries            = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] num_shell_tries                = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] num_volume_device_scan_tries   = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] nvmeof_conn_info_version       = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] nvmet_ns_id                    = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] nvmet_port_id                  = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_max_limit                = 1000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_ext_list          = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_listen_port       = 8776 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_use_ssl           = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] osapi_volume_workers           = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] per_volume_size_limit          = -1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] periodic_fuzzy_delay           = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] periodic_interval              = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] public_endpoint                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] publish_errors                 = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_backup_gigabytes         = 1000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_backups                  = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_gigabytes                = 1000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_groups                   = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_snapshots                = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] quota_volumes                  = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] rate_limit_burst               = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] rate_limit_except_level        = CRITICAL {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] rate_limit_interval            = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] reinit_driver_count            = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] replication_device             = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] report_discard_supported       = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] report_interval                = 120 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] reservation_clean_interval     = 86400 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] reservation_expire             = 86400 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] reserved_image_namespaces      = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] reserved_percentage            = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] rpc_response_timeout           = 120 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] run_external_periodic_tasks    = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] scst_target_driver             = iscsi {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] scst_target_iqn_name           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_down_time              = 720 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] shell_completion               = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] snapshot_name_template         = snapshot-%s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] snapshot_same_host             = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] split_loggers                  = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] state_path                     = /opt/stack/data/cinder {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] storage_availability_zone      = nova {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] storage_protocol               = iSCSI {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] syslog_log_facility            = LOG_USER {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_helper                  = lioadm {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_ip_address              = 192.168.122.252 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_port                    = 3260 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_protocol                = iscsi {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] target_secondary_ip_addresses  = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] trace_flags                    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] transport_url                  = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] until_refresh                  = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_chap_auth                  = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_default_quota_class        = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_journal                    = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_json                       = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_multipath_for_image_xfer   = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_stderr                     = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] use_syslog                     = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] verify_glance_signatures       = enabled {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_api_class               = cinder.volume.api.API {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_backend_name            = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_clear                   = zero {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_clear_ionice            = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_clear_size              = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_copy_bps_limit          = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_dd_blocksize            = 1M {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_name_template           = volume-%s {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_service_inithost_offload = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volume_usage_audit_period      = month {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] zoning_mode                    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_concurrency.disable_process_locking = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.admin_password = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.admin_token = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.admin_user  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_port   = 35357 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_protocol = https {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_section = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_type   = password {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_uri    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.auth_version = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.cache       = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.certfile    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.delay_auth_decision = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.http_connect_timeout = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.identity_uri = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.include_service_catalog = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.insecure    = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.interface   = public {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.keyfile     = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_password =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcache_username =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.region_name = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.service_token_roles_required = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.service_type = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.token_cache_time = 300 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.backend                  = dogpile.cache.null {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.backend_argument         = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.backend_expiration_time  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.config_prefix            = cache.oslo {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.debug_cache_backend      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.enable_retry_client      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.enable_socket_keepalive  = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.enabled                  = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.enforce_fips_mode        = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.expiration_time          = 600 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.hashclient_retry_attempts = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_dead_retry      = 300 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_pool_maxsize    = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_sasl_enabled    = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.password                 = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.proxies                  = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.redis_db                 = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.redis_sentinel_service_name = mymaster {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.redis_server             = localhost:6379 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.retry_attempts           = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.retry_delay              = 0.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.socket_keepalive_count   = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.socket_keepalive_idle    = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.socket_keepalive_interval = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.socket_timeout           = 1.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.tls_allowed_ciphers      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.tls_cafile               = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.tls_certfile             = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.tls_enabled              = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.tls_keyfile              = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cache.username                 = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.asyncio_connection    = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.asyncio_slave_connection = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.backend               = sqlalchemy {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.connection            = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.connection_debug      = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.connection_parameters =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.connection_recycle_time = 3600 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.connection_trace      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.db_inc_retry_interval = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.db_max_retries        = 20 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.db_max_retry_interval = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.db_retry_interval     = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.max_overflow          = 50 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.max_pool_size         = 5 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.max_retries           = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.mysql_wsrep_sync_wait = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.pool_timeout          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.retry_interval        = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.slave_connection      = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.sqlite_synchronous    = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.synchronous_reader    = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] database.use_db_reconnect      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.connection_string     = messaging:// {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.enabled               = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.es_doc_type           = notification {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.es_scroll_size        = 10000 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.es_scroll_time        = 2m {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.filter_error_trace    = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.hmac_keys             = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.sentinel_service_name = mymaster {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.socket_timeout        = 0.1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.trace_requests        = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler.trace_sqlalchemy      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler_jaeger.process_tags   = {} {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler_jaeger.service_name_prefix = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] profiler_otlp.service_name_prefix = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.enforce_new_defaults = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: WARNING oslo_config.cfg [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.enforce_scope      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.policy_default_rule = default {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.policy_file        = policy.yaml {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] coordination.backend_url       = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.group          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.helper_command = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] privsep_osbrick.user           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.group         = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.helper_command = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] cinder_sys_admin.user          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.auth_section      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.auth_type         = password {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.cafile            = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.certfile          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.collect_timing    = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.insecure          = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.keyfile           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.send_service_user_token = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.split_loggers     = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] service_user.timeout           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.auth_section            = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.auth_type               = password {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.certfile                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.collect_timing          = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.insecure                = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.keyfile                 = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.region_name             = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.split_loggers           = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] glance.timeout                 = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.backend_availability_zone = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.chap_password = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.chap_username =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.disk_geometry = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_client_cert = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_client_cert_key = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_data_namespace = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.driver_use_ssl = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.enable_unsupported_driver = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.extra_capabilities = {} {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.filter_function = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.goodness_function = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iscsi_target_flags =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iscsi_write_cache = on {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iser_helper   = tgtadm {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iser_port     = 3260 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.lvm_share_target = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.lvm_type      = auto {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.num_shell_tries = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.nvmet_port_id = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.replication_device = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.report_discard_supported = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.reserved_percentage = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.scst_target_driver = iscsi {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack sudo[81559]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.scst_target_iqn_name = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.storage_protocol = iSCSI {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_helper = tgtadm {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_port   = 3260 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_protocol = iscsi {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.trace_flags   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.unique_fqdn_network = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.use_chap_auth = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_backend_name = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_clear  = zero {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_clear_ionice = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_clear_size = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_reports.file_event_handler = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_reports.log_dir           = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.backend_availability_zone = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.backend_host       = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.chap_password      = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.chap_username      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.disk_geometry      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_client_cert = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_data_namespace = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.extra_capabilities = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.filter_function    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.goodness_function  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iser_helper        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iser_ip_address    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iser_port          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.iser_target_prefix = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.lvm_share_target   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.lvm_type           = auto {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.num_shell_tries    = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.replication_device = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.report_discard_supported = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.reserved_percentage = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.scst_target_driver = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.storage_protocol   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_helper      = lioadm {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_ip_address  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_port        = 3260 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.trace_flags        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.use_chap_auth      = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_clear       = zero {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_clear_size  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] lvmdriver-1.volumes_dir        = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack sudo[81748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack sudo[81748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl      = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_notifications.driver = [] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_notifications.retry = -1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] key_manager.fixed_key          = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.barbican_api_version  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.barbican_endpoint     = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.barbican_endpoint_type = public {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.barbican_region_name  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.cafile                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.certfile              = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.collect_timing        = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.insecure              = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.keyfile               = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.number_of_retries     = 60 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.retry_delay           = 1 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.send_service_user_token = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.split_loggers         = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.timeout               = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.verify_ssl            = True {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican.verify_ssl_path       = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.auth_section = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.auth_type = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.cafile   = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.certfile = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.collect_timing = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.insecure = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.keyfile  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.split_loggers = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] barbican_service_user.timeout  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.approle_role_id          = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.approle_secret_id        = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.kv_mountpoint            = secret {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.kv_path                  = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.kv_version               = 2 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.namespace                = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.root_token_id            = **** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.ssl_ca_crt_file          = None {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.timeout                  = 60.0 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.use_ssl                  = False {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 03:56:10 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] ******************************************************************************** {{(pid=81385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.867s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:10 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:11 devstack sudo[81748]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:11 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.617s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:11 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 03:56:11 devstack cinder-volume[81555]: INFO cinder.brick.local_dev.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 17 03:56:11 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:11 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:11 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:11 devstack sudo[81942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:11 devstack sudo[81942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:12 devstack sudo[81942]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:12 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:12 devstack cinder-volume[81555]: DEBUG cinder.brick.local_dev.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81555) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 17 03:56:12 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:12 devstack sudo[82120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:12 devstack sudo[82120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:13 devstack sudo[82120]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:13 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.094s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:13 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:13 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:13 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:13 devstack sudo[82324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:13 devstack sudo[82324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:14 devstack sudo[82324]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.841s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:14 devstack sudo[82339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 17 03:56:14 devstack sudo[82339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:14 devstack sudo[82339]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.697s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:14 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:14 devstack sudo[82347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:14 devstack sudo[82347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:15 devstack sudo[82347]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:15 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:15 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:15 devstack sudo[82352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:15 devstack sudo[82352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:16 devstack sudo[82352]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:16 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:16 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:16 devstack sudo[82355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:16 devstack sudo[82355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:16 devstack sudo[82355]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:16 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:16 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:16 devstack sudo[82360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:16 devstack sudo[82360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:17 devstack sudo[82360]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:17 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.794s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:17 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:17 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:17 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:17 devstack sudo[82368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:17 devstack sudo[82368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:18 devstack sudo[82368]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:18 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.788s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:18 devstack cinder-volume[81555]: INFO cinder.volume.drivers.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 17 03:56:18 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:18 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:18 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:18 devstack sudo[82405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:18 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:19 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:19 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.766s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:19 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:56:19 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:19 devstack sudo[82491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:19 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:19 devstack cinder-volume[81385]: DEBUG dbcounter [-] [81385] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 03:56:19 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:19 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:19 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:19 devstack sudo[82618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:19 devstack sudo[82618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:20 devstack sudo[82618]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:20 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:20 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:20 devstack sudo[82636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:20 devstack sudo[82636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:21 devstack sudo[82636]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:21 devstack sudo[82642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:21 devstack sudo[82642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:21 devstack sudo[82642]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:21 devstack cinder-volume[81555]: INFO cinder.volume.driver [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Driver hasn't implemented _init_vendor_properties()
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG cinder.volume.driver [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81555) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG oslo_db.sqlalchemy.engines [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81555) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writer thread running {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG cinder.db.sqlalchemy.api [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Building query based on filter {{(pid=81555) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG cinder.image.image_utils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81555) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 17 03:56:21 devstack cinder-volume[81555]: INFO cinder.keymgr.migration [None req-9b124193-9593-469a-95f8-fcb114413770 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:56:21 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:21 devstack sudo[82646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:21 devstack sudo[82646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:22 devstack sudo[82646]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:22 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:22 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:22 devstack sudo[82649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:22 devstack sudo[82649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:22 devstack sudo[82649]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:22 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:22 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:22 devstack sudo[82652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:23 devstack sudo[82652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:23 devstack sudo[82652]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:23 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:23 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:23 devstack sudo[82655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:23 devstack sudo[82655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:24 devstack sudo[82655]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG cinder.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Notifying Schedulers of capabilities ... {{(pid=81555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 03:56:24 devstack cinder-volume[81555]: INFO cinder.volume.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Driver initialization completed successfully.
Jun 17 03:56:24 devstack cinder-volume[81555]: INFO cinder.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Initiating service 2 cleanup
Jun 17 03:56:24 devstack cinder-volume[81555]: INFO cinder.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Service 2 cleanup completed.
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG cinder.service [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Creating RPC server for service cinder-volume {{(pid=81555) start /opt/stack/cinder/cinder/service.py:231}}
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG cinder.service [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81555) start /opt/stack/cinder/cinder/service.py:237}}
Jun 17 03:56:24 devstack cinder-volume[81555]: INFO cinder.volume.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:56:24 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:24 devstack sudo[82662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:56:24 devstack sudo[82662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:25 devstack sudo[82662]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:25 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:25 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:25 devstack sudo[82668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:25 devstack sudo[82668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:25 devstack sudo[82668]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:25 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:25 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:25 devstack sudo[82671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:56:25 devstack sudo[82671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:26 devstack sudo[82671]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:26 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.582s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:26 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:56:26 devstack sudo[82728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:56:26 devstack sudo[82728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:56:26 devstack sudo[82728]: pam_unix(sudo:session): session closed for user root
Jun 17 03:56:26 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:56:26 devstack cinder-volume[81555]: INFO cinder.volume.manager [None req-b827df5e-a4ec-49ec-bc84-7d4202ed8b2f None None] Driver post RPC initialization completed successfully.
Jun 17 03:56:36 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 03:56:36 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 03:56:38 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager._thread_info {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:56:38 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread count: 6 {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 03:56:38 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread info: [<_MainThread(MainThread, started 128472161493120)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128472050593856)>, <Thread(Thread-3 (stat_writer), started daemon 128472052616704)>, <Thread(Rabbit-heartbeat, started daemon 128472053231168)>, <Thread(Thread-5 (_runner), started daemon 128472050059520)>, <Thread(Thread-7 (_runner), started daemon 128472050142784)>] {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 03:57:38 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:57:38 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:57:38 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:57:38 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:57:38 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:57:39 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Jun 17 03:57:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:57:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:57:39 devstack sudo[84974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:57:39 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:57:40 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root
Jun 17 03:57:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:57:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:57:40 devstack sudo[85228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:57:40 devstack sudo[85228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:57:40 devstack sudo[85228]: pam_unix(sudo:session): session closed for user root
Jun 17 03:57:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.585s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:57:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:57:40 devstack sudo[85539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:57:40 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:57:41 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root
Jun 17 03:57:41 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:57:41 devstack cinder-volume[81555]: DEBUG cinder.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Notifying Schedulers of capabilities ... {{(pid=81555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 03:57:41 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager._thread_info {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:57:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread count: 6 {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 03:57:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread info: [<_MainThread(MainThread, started 128472161493120)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128472050593856)>, <Thread(Thread-3 (stat_writer), started daemon 128472052616704)>, <Thread(Rabbit-heartbeat, started daemon 128472053231168)>, <Thread(Thread-5 (_runner), started daemon 128472050059520)>, <Thread(Thread-7 (_runner), started daemon 128472050142784)>] {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 03:58:36 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 03:58:38 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:58:38 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:58:38 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:58:38 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:58:38 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:58:39 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Jun 17 03:58:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:58:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:58:39 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:58:39 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:58:40 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Jun 17 03:58:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:58:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:58:40 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:58:40 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:58:40 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Jun 17 03:58:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.588s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:58:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:58:40 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:58:40 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:58:41 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Jun 17 03:58:41 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:58:41 devstack cinder-volume[81555]: DEBUG cinder.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Notifying Schedulers of capabilities ... {{(pid=81555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 03:58:41 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager._thread_info {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:58:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread count: 6 {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 03:58:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread info: [<_MainThread(MainThread, started 128472161493120)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128472050593856)>, <Thread(Thread-3 (stat_writer), started daemon 128472052616704)>, <Thread(Rabbit-heartbeat, started daemon 128472053231168)>, <Thread(Thread-5 (_runner), started daemon 128472050059520)>, <Thread(Thread-7 (_runner), started daemon 128472050142784)>] {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 03:59:38 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:59:38 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 03:59:38 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:59:38 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 03:59:38 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:59:39 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Jun 17 03:59:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:59:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:59:39 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:59:39 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:59:39 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Jun 17 03:59:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:59:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:59:40 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 03:59:40 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:59:40 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Jun 17 03:59:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.583s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:59:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 03:59:40 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 03:59:40 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 03:59:41 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Jun 17 03:59:41 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 03:59:41 devstack cinder-volume[81555]: DEBUG cinder.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Notifying Schedulers of capabilities ... {{(pid=81555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 03:59:41 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager._thread_info {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 03:59:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread count: 6 {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 03:59:41 devstack cinder-volume[81555]: DEBUG cinder.volume.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] thread info: [<_MainThread(MainThread, started 128472161493120)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128472050593856)>, <Thread(Thread-3 (stat_writer), started daemon 128472052616704)>, <Thread(Rabbit-heartbeat, started daemon 128472053231168)>, <Thread(Thread-5 (_runner), started daemon 128472050059520)>, <Thread(Thread-7 (_runner), started daemon 128472050142784)>] {{(pid=81555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:00:36 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writing DB stats cinder:SELECT=1 {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:00:36 devstack cinder-volume[81555]: DEBUG dbcounter [-] [81555] Writing DB stats cinder:UPDATE=1 {{(pid=81555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:00:38 devstack cinder-volume[81555]: DEBUG oslo_service.periodic_task [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:00:38 devstack cinder-volume[81555]: DEBUG cinder.volume.drivers.lvm [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Updating volume stats {{(pid=81555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 17 04:00:38 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:38 devstack sudo[91000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 17 04:00:38 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:39 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:39 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:39 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 04:00:39 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:40 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:40 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 17 04:00:40 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:40 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.580s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:40 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:40 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 17 04:00:40 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:41 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:41 devstack cinder-volume[81555]: DEBUG oslo_concurrency.processutils [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=81555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:41 devstack cinder-volume[81555]: DEBUG cinder.manager [None req-0d16e55e-f9b8-40b3-9142-38c99b18ffc6 None None] Notifying Schedulers of capabilities ... {{(pid=81555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:00:44 devstack cinder-volume[81385]: INFO oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Caught SIGTERM, stopping children
Jun 17 04:00:44 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Acquiring lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:00:44 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Acquired lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:00:44 devstack cinder-volume[81385]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Releasing lock "singleton_lock" {{(pid=81385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:00:44 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Stop services. {{(pid=81385) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 17 04:00:44 devstack cinder-volume[81385]: DEBUG oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Killing children. {{(pid=81385) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 17 04:00:44 devstack cinder-volume[81385]: INFO oslo_service.backend._eventlet.service [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Waiting on 1 children to exit
Jun 17 04:00:49 devstack cinder-volume[81555]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 17 04:00:49 devstack cinder-volume[81555]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Acquiring lock "singleton_lock" {{(pid=81555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:00:49 devstack cinder-volume[81555]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Acquired lock "singleton_lock" {{(pid=81555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:00:49 devstack cinder-volume[81555]: DEBUG oslo_concurrency.lockutils [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Releasing lock "singleton_lock" {{(pid=81555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:00:49 devstack cinder-volume[81555]: WARNING amqp [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 17 04:00:49 devstack cinder-volume[81555]: WARNING amqp [None req-f7d4e3a6-2f01-4578-b19d-5e4c7b8fee6e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 17 04:00:51 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:00:51 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:00:51 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO dbcounter [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Registered counter for database cinder
Jun 17 04:00:52 devstack cinder-volume[91285]: DEBUG oslo_db.sqlalchemy.engines [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:00:52 devstack cinder-volume[91285]: DEBUG dbcounter [-] [91285] Writer thread running {{(pid=91285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO cinder.rpc [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO cinder.rpc [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 17 04:00:52 devstack cinder-volume[91285]: DEBUG oslo_db.sqlalchemy.engines [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO cinder.volume.manager [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Determined volume DB was empty at startup.
Jun 17 04:00:52 devstack cinder-volume[91285]: DEBUG cinder.volume.manager [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91285) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO cinder.volume.manager [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 17 04:00:52 devstack cinder-volume[91285]: WARNING stevedore.named [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 17 04:00:52 devstack cinder-volume[91285]: WARNING castellan.key_manager [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 04:00:52 devstack cinder-volume[91285]: WARNING cinder.keymgr.conf_key_mgr [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 04:00:52 devstack cinder-volume[91285]: INFO cinder.volume.manager [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 17 04:00:52 devstack cinder-volume[91285]: DEBUG oslo_db.sqlalchemy.engines [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:00:53 devstack cinder-volume[91285]: INFO oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Starting 1 workers
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Started child 91499 {{(pid=91285) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Full set of CONF: {{(pid=91285) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] ******************************************************************************** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Configuration options gathered from: {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] ================================================================================ {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] allow_availability_zone_fallback = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] allow_compression_on_image_upload = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] allowed_direct_url_schemes     = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] api_rate_limit                 = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] auth_strategy                  = keystone {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_availability_zone      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_host                   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_name                   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_stats_polling_interval = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backup_api_class               = cinder.backup.api.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backup_name_template           = backup-%s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backup_use_same_host           = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backup_use_temp_snapshot       = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] chap_password                  = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] chap_username                  =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_internal_tenant_project_id = e31e24ea8ea14a36bbe24802133522ae {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_internal_tenant_user_id = e326e3eff7fa40418be9d9405e0a3ffe {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cluster                        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] compression_format             = gzip {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] compute_api_class              = cinder.compute.nova.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] config_dir                     = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91499]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] config_source                  = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] control_exchange               = openstack {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] debug                          = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] default_availability_zone      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] default_group_type             = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] default_volume_type            = QuobyteHD {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] disk_geometry                  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_client_cert             = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_client_cert_key         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_data_namespace          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_ssl_cert_path           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_ssl_cert_verify         = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] driver_use_ssl                 = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] enable_new_services            = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] enable_unsupported_driver      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] enabled_backends               = ['QuobyteHD'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] enforce_multipath_for_image_xfer = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] filter_function                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_api_insecure            = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_api_servers             = ['http://192.168.122.252/image'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_api_ssl_compression     = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_ca_certificates_file    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_catalog_info            = image:glance:publicURL {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_certfile                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_keyfile                 = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_num_retries             = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance_request_timeout         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] goodness_function              = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] graceful_shutdown_timeout      = 5 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] group_api_class                = cinder.group.api.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] host                           = devstack {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_compress_on_upload       = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_conversion_address_space_limit = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_conversion_cpu_limit     = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_conversion_disable       = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_upload_use_cinder_backend = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_upload_use_internal_tenant = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_volume_cache_enabled     = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_volume_cache_max_count   = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] image_volume_cache_max_size_gb = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] init_host_max_objects_retrieval = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] instance_format                = [instance: %(uuid)s]  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iscsi_target_flags             =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iscsi_write_cache              = on {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iser_helper                    = tgtadm {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iser_ip_address                = 192.168.122.252 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iser_port                      = 3260 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_color                      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_config_append              = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_dir                        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_file                       = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_options                    = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_rotate_interval            = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_rotate_interval_type       = days {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] log_rotation_type              = none {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] max_age                        = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] max_logfile_count              = 30 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] max_logfile_size_mb            = 200 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] max_over_subscription_ratio    = 20.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] message_reap_interval          = 86400 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] message_ttl                    = 2592000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] migration_create_volume_timeout_secs = 300 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] monkey_patch                   = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] monkey_patch_modules           = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] my_ip                          = 192.168.122.252 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] no_snapshot_gb_quota           = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] num_iser_scan_tries            = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] num_shell_tries                = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] num_volume_device_scan_tries   = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91499]: INFO cinder.volume.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.remotefs [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91499) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] nvmeof_conn_info_version       = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] nvmet_ns_id                    = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] nvmet_port_id                  = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_max_limit                = 1000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_ext_list          = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_listen_port       = 8776 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_use_ssl           = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] osapi_volume_workers           = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] per_volume_size_limit          = -1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] periodic_fuzzy_delay           = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] periodic_interval              = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] public_endpoint                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] publish_errors                 = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_backup_gigabytes         = 1000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_backups                  = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_gigabytes                = 1000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_groups                   = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_snapshots                = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] quota_volumes                  = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] rate_limit_burst               = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] rate_limit_except_level        = CRITICAL {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] rate_limit_interval            = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] reinit_driver_count            = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] replication_device             = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] report_discard_supported       = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] report_interval                = 120 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] reservation_clean_interval     = 86400 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] reservation_expire             = 86400 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] reserved_image_namespaces      = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] reserved_percentage            = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] rpc_response_timeout           = 120 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] run_external_periodic_tasks    = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] scst_target_driver             = iscsi {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] scst_target_iqn_name           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_down_time              = 720 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] shell_completion               = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] snapshot_name_template         = snapshot-%s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] split_loggers                  = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] state_path                     = /opt/stack/data/cinder {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] storage_availability_zone      = nova {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] storage_protocol               = iSCSI {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] syslog_log_facility            = LOG_USER {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_helper                  = lioadm {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_ip_address              = 192.168.122.252 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_port                    = 3260 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_protocol                = iscsi {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] target_secondary_ip_addresses  = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] trace_flags                    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] transport_url                  = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] until_refresh                  = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_chap_auth                  = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_default_quota_class        = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_journal                    = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_json                       = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_multipath_for_image_xfer   = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_stderr                     = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] use_syslog                     = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] verify_glance_signatures       = enabled {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_api_class               = cinder.volume.api.API {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_backend_name            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_clear                   = zero {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_clear_ionice            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_clear_size              = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_copy_bps_limit          = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_dd_blocksize            = 1M {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_name_template           = volume-%s {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_service_inithost_offload = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volume_usage_audit_period      = month {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] zoning_mode                    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_concurrency.disable_process_locking = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.admin_password = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.admin_token = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.admin_user  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_port   = 35357 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_protocol = https {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_section = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_type   = password {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_uri    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.auth_version = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.cache       = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.certfile    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.delay_auth_decision = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.http_connect_timeout = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.identity_uri = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.include_service_catalog = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.insecure    = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.interface   = public {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.keyfile     = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_password =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcache_username =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.region_name = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.service_token_roles_required = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.service_type = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.token_cache_time = 300 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.backend                  = dogpile.cache.null {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.backend_argument         = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.backend_expiration_time  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.config_prefix            = cache.oslo {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.debug_cache_backend      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.enable_retry_client      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.enable_socket_keepalive  = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.enabled                  = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.enforce_fips_mode        = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.expiration_time          = 600 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.hashclient_retry_attempts = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_dead_retry      = 300 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_pool_maxsize    = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_sasl_enabled    = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.password                 = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.proxies                  = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.redis_db                 = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.redis_sentinel_service_name = mymaster {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.redis_server             = localhost:6379 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.retry_attempts           = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.retry_delay              = 0.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.socket_keepalive_count   = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.socket_keepalive_idle    = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.socket_keepalive_interval = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.socket_timeout           = 1.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.tls_allowed_ciphers      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.tls_cafile               = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.tls_certfile             = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.tls_enabled              = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.tls_keyfile              = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cache.username                 = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.asyncio_connection    = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.asyncio_slave_connection = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.backend               = sqlalchemy {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.connection            = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.connection_debug      = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.connection_parameters =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.connection_recycle_time = 3600 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.connection_trace      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.db_inc_retry_interval = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.db_max_retries        = 20 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.db_max_retry_interval = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.db_retry_interval     = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.max_overflow          = 50 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.max_pool_size         = 5 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.max_retries           = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.mysql_wsrep_sync_wait = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.pool_timeout          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.retry_interval        = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.slave_connection      = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.sqlite_synchronous    = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.synchronous_reader    = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] database.use_db_reconnect      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.connection_string     = messaging:// {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.enabled               = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.es_doc_type           = notification {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.es_scroll_size        = 10000 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.es_scroll_time        = 2m {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.filter_error_trace    = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.hmac_keys             = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.sentinel_service_name = mymaster {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.socket_timeout        = 0.1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.trace_requests        = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler.trace_sqlalchemy      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler_jaeger.process_tags   = {} {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler_jaeger.service_name_prefix = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] profiler_otlp.service_name_prefix = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.enforce_new_defaults = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: WARNING oslo_config.cfg [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.enforce_scope      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.policy_default_rule = default {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.policy_file        = policy.yaml {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] coordination.backend_url       = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.group          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.helper_command = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] privsep_osbrick.user           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.group         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91499) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.helper_command = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] cinder_sys_admin.user          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.auth_section      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.auth_type         = password {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.cafile            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.certfile          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.collect_timing    = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.insecure          = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: WARNING cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.keyfile           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: WARNING cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.send_service_user_token = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.split_loggers     = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] service_user.timeout           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.auth_section            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.auth_type               = password {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Running cmd (subprocess): mount.quobyte {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.certfile                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.collect_timing          = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.insecure                = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.keyfile                 = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.region_name             = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.split_loggers           = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] glance.timeout                 = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.backend_availability_zone = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.chap_password = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.chap_username =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.disk_geometry = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_client_cert = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_client_cert_key = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_data_namespace = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.driver_use_ssl = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.enable_unsupported_driver = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.extra_capabilities = {} {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.filter_function = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.goodness_function = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iscsi_target_flags =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iscsi_write_cache = on {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iser_helper   = tgtadm {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iser_port     = 3260 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_host      =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_login     = admin {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_mount_options = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_password  = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_private_key =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_share_path =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.num_shell_tries = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.nvmet_port_id = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_client_cfg = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.quobyte_volume_url = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.replication_device = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.report_discard_supported = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.reserved_percentage = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.scst_target_driver = iscsi {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.scst_target_iqn_name = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.storage_protocol = iSCSI {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_helper = tgtadm {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_port   = 3260 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_protocol = iscsi {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.trace_flags   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.unique_fqdn_network = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.use_chap_auth = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_backend_name = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_clear  = zero {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_clear_ionice = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_clear_size = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_reports.file_event_handler = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_reports.log_dir           = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.backend_availability_zone = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.backend_host         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.chap_password        = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.chap_username        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.chiscsi_conf         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.disk_geometry        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_client_cert   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_client_cert_key = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_data_namespace = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.driver_use_ssl       = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.extra_capabilities   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.filter_function      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.goodness_function    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iser_helper          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iser_ip_address      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iser_port            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.iser_target_prefix   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_host             = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_login            = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_mount_options    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_password         = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_private_key      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_share_path       = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_ssh_port         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.num_shell_tries      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.nvmet_port_id        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.replication_device   = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.report_discard_supported = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.reserved_percentage  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.scst_target_driver   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.storage_protocol     = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_helper        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_ip_address    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_port          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_prefix        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_protocol      = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.trace_flags          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.use_chap_auth        = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_clear         = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_clear_size    = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] QuobyteHD.volumes_dir          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack quobyte-client[91500]: Reading configuration file: /etc/quobyte/client.cfg
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack quobyte-client[91500]: Invalid parameters found, error: missing mount point.
Jun 17 04:00:53 devstack quobyte-client[91500]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 17 04:00:53 devstack quobyte-client[91500]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] CMD "mount.quobyte" returned: 1 in 0.150s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=91499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: INFO cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd ...
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl      = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f -c /etc/quobyte/client-cinder.cfg {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_notifications.driver = [] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_notifications.retry = -1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] oslo_messaging_notifications.transport_url = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] key_manager.fixed_key          = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.barbican_api_version  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.barbican_endpoint     = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.barbican_endpoint_type = public {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.barbican_region_name  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.cafile                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.certfile              = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.collect_timing        = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.insecure              = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.keyfile               = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.number_of_retries     = 60 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.retry_delay           = 1 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.send_service_user_token = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.split_loggers         = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.timeout               = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.verify_ssl            = True {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican.verify_ssl_path       = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.auth_section = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.auth_type = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.cafile   = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.certfile = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.collect_timing = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.insecure = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.keyfile  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.split_loggers = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] barbican_service_user.timeout  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.approle_role_id          = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.approle_secret_id        = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.kv_mountpoint            = secret {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.kv_path                  = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.kv_version               = 2 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.namespace                = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.root_token_id            = **** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.ssl_ca_crt_file          = None {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.timeout                  = 60.0 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.use_ssl                  = False {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:00:53 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] ******************************************************************************** {{(pid=91285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 17 04:00:53 devstack sudo[91505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f -c /etc/quobyte/client-cinder.cfg
Jun 17 04:00:53 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:54 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.746s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:54 devstack cinder-volume[91499]: INFO cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd succeeded
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=91499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.761s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:54 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:00:54 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:54 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.626s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:54 devstack cinder-volume[91499]: INFO cinder.volume.driver [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Driver hasn't implemented _init_vendor_properties()
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.volume.driver [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91499) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_db.sqlalchemy.engines [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG dbcounter [-] [91499] Writer thread running {{(pid=91499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.db.sqlalchemy.api [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Building query based on filter {{(pid=91499) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.image.image_utils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91499) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 17 04:00:54 devstack cinder-volume[91499]: INFO cinder.keymgr.migration [None req-a863b3e5-ea46-474f-ac21-614ffa0e9a9d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=91499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=91499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:00:54 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:54 devstack sudo[91579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:00:54 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:55 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.685s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG cinder.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Notifying Schedulers of capabilities ... {{(pid=91499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:00:55 devstack cinder-volume[91499]: INFO cinder.volume.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Driver initialization completed successfully.
Jun 17 04:00:55 devstack cinder-volume[91499]: INFO cinder.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Initiating service 3 cleanup
Jun 17 04:00:55 devstack cinder-volume[91499]: INFO cinder.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Service 3 cleanup completed.
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG cinder.service [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Creating RPC server for service cinder-volume {{(pid=91499) start /opt/stack/cinder/cinder/service.py:231}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG cinder.service [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91499) start /opt/stack/cinder/cinder/service.py:237}}
Jun 17 04:00:55 devstack cinder-volume[91499]: INFO cinder.volume.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=91499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=91499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:00:55 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:55 devstack sudo[91611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:00:55 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:00:56 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root
Jun 17 04:00:56 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.897s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:00:56 devstack cinder-volume[91499]: INFO cinder.volume.manager [None req-ae3619b8-1267-4e98-8fc2-e0c8f93f32a5 None None] Driver post RPC initialization completed successfully.
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=91499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG cinder.volume.drivers.quobyte [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=91499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:00:59 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:00:59 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:00:59 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:01:00 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Jun 17 04:01:00 devstack cinder-volume[91499]: DEBUG oslo_concurrency.processutils [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.593s {{(pid=91499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:01:00 devstack cinder-volume[91499]: DEBUG cinder.manager [None req-6ca104fb-a565-40ff-8b53-9043f0c50760 None None] Notifying Schedulers of capabilities ... {{(pid=91499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:01:02 devstack cinder-volume[91285]: INFO oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Caught SIGTERM, stopping children
Jun 17 04:01:02 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Acquiring lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:01:02 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Acquired lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:01:02 devstack cinder-volume[91285]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Releasing lock "singleton_lock" {{(pid=91285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:01:02 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Stop services. {{(pid=91285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 17 04:01:02 devstack cinder-volume[91285]: DEBUG oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Killing children. {{(pid=91285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 17 04:01:02 devstack cinder-volume[91285]: INFO oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Waiting on 1 children to exit
Jun 17 04:01:04 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Acquiring lock "singleton_lock" {{(pid=91499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:01:04 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Acquired lock "singleton_lock" {{(pid=91499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:01:04 devstack cinder-volume[91499]: DEBUG oslo_concurrency.lockutils [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Releasing lock "singleton_lock" {{(pid=91499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:01:04 devstack cinder-volume[91499]: WARNING amqp [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 17 04:01:04 devstack cinder-volume[91499]: WARNING amqp [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 17 04:01:04 devstack cinder-volume[91285]: INFO oslo_service.backend._eventlet.service [None req-54b9df0a-c627-4bec-9a33-d0a3af68529a None None] Child 91499 exited with status 0
Jun 17 04:01:07 devstack cinder-volume[91909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 17 04:01:07 devstack cinder-volume[91909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 17 04:01:07 devstack cinder-volume[91909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 17 04:01:08 devstack cinder-volume[91909]: INFO dbcounter [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Registered counter for database cinder
Jun 17 04:01:08 devstack cinder-volume[91909]: DEBUG oslo_db.sqlalchemy.engines [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:01:08 devstack cinder-volume[91909]: DEBUG dbcounter [-] [91909] Writer thread running {{(pid=91909) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 04:01:08 devstack cinder-volume[91909]: INFO cinder.rpc [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 17 04:01:08 devstack cinder-volume[91909]: INFO cinder.rpc [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 17 04:01:08 devstack cinder-volume[91909]: DEBUG oslo_db.sqlalchemy.engines [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:01:09 devstack cinder-volume[91909]: INFO cinder.volume.manager [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Determined volume DB was empty at startup.
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG cinder.volume.manager [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91909) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 17 04:01:09 devstack cinder-volume[91909]: WARNING stevedore.named [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 17 04:01:09 devstack cinder-volume[91909]: WARNING castellan.key_manager [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 04:01:09 devstack cinder-volume[91909]: WARNING cinder.keymgr.conf_key_mgr [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 17 04:01:09 devstack cinder-volume[91909]: INFO cinder.volume.manager [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_db.sqlalchemy.engines [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:01:09 devstack cinder-volume[91909]: INFO oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Starting 1 workers
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Started child 92204 {{(pid=91909) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Full set of CONF: {{(pid=91909) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] ******************************************************************************** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Configuration options gathered from: {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] ================================================================================ {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] allow_availability_zone_fallback = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] allow_compression_on_image_upload = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] allowed_direct_url_schemes     = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[92204]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] api_rate_limit                 = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] auth_strategy                  = keystone {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_availability_zone      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_host                   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_name                   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_stats_polling_interval = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backup_api_class               = cinder.backup.api.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backup_name_template           = backup-%s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backup_use_same_host           = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backup_use_temp_snapshot       = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] chap_password                  = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] chap_username                  =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_internal_tenant_project_id = e31e24ea8ea14a36bbe24802133522ae {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_internal_tenant_user_id = e326e3eff7fa40418be9d9405e0a3ffe {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cluster                        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] compression_format             = gzip {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] compute_api_class              = cinder.compute.nova.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] config_dir                     = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] config_source                  = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] control_exchange               = openstack {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] debug                          = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] default_availability_zone      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] default_group_type             = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] default_volume_type            = QuobyteHD {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] disk_geometry                  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_client_cert             = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_client_cert_key         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_data_namespace          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_ssl_cert_path           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_ssl_cert_verify         = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] driver_use_ssl                 = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] enable_new_services            = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] enable_unsupported_driver      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] enabled_backends               = ['QuobyteHD'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] enforce_multipath_for_image_xfer = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] filter_function                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_api_insecure            = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_api_servers             = ['http://192.168.122.252/image'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_api_ssl_compression     = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_ca_certificates_file    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_catalog_info            = image:glance:publicURL {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_certfile                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_keyfile                 = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_num_retries             = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance_request_timeout         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] goodness_function              = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] graceful_shutdown_timeout      = 5 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] group_api_class                = cinder.group.api.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] host                           = devstack {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_compress_on_upload       = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_conversion_address_space_limit = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_conversion_cpu_limit     = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_conversion_disable       = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_upload_use_cinder_backend = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92204) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_upload_use_internal_tenant = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_volume_cache_enabled     = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_volume_cache_max_count   = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] image_volume_cache_max_size_gb = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] init_host_max_objects_retrieval = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] instance_format                = [instance: %(uuid)s]  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iscsi_target_flags             =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iscsi_write_cache              = on {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iser_helper                    = tgtadm {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iser_ip_address                = 192.168.122.252 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iser_port                      = 3260 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_color                      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_config_append              = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_dir                        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_file                       = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_options                    = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_rotate_interval            = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_rotate_interval_type       = days {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] log_rotation_type              = none {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] max_age                        = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] max_logfile_count              = 30 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] max_logfile_size_mb            = 200 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] max_over_subscription_ratio    = 20.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] message_reap_interval          = 86400 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] message_ttl                    = 2592000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] migration_create_volume_timeout_secs = 300 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] monkey_patch                   = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] monkey_patch_modules           = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] my_ip                          = 192.168.122.252 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] no_snapshot_gb_quota           = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] num_iser_scan_tries            = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] num_shell_tries                = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] num_volume_device_scan_tries   = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] nvmeof_conn_info_version       = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] nvmet_ns_id                    = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] nvmet_port_id                  = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_max_limit                = 1000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_ext_list          = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_listen_port       = 8776 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_use_ssl           = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] osapi_volume_workers           = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] per_volume_size_limit          = -1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] periodic_fuzzy_delay           = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] periodic_interval              = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] public_endpoint                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] publish_errors                 = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_backup_gigabytes         = 1000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_backups                  = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_gigabytes                = 1000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_groups                   = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_snapshots                = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] quota_volumes                  = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] rate_limit_burst               = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] rate_limit_except_level        = CRITICAL {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] rate_limit_interval            = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] reinit_driver_count            = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] replication_device             = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] report_discard_supported       = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] report_interval                = 120 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] reservation_clean_interval     = 86400 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] reservation_expire             = 86400 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] reserved_image_namespaces      = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] reserved_percentage            = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] rpc_response_timeout           = 120 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] run_external_periodic_tasks    = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] scst_target_driver             = iscsi {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] scst_target_iqn_name           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_down_time              = 720 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] shell_completion               = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] snapshot_name_template         = snapshot-%s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] split_loggers                  = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] state_path                     = /opt/stack/data/cinder {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] storage_availability_zone      = nova {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] storage_protocol               = iSCSI {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] syslog_log_facility            = LOG_USER {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_helper                  = lioadm {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_ip_address              = 192.168.122.252 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_port                    = 3260 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_protocol                = iscsi {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] target_secondary_ip_addresses  = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] trace_flags                    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] transport_url                  = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] until_refresh                  = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_chap_auth                  = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_default_quota_class        = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_journal                    = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_json                       = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_multipath_for_image_xfer   = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_stderr                     = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] use_syslog                     = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] verify_glance_signatures       = enabled {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_api_class               = cinder.volume.api.API {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_backend_name            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_clear                   = zero {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_clear_ionice            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_clear_size              = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_copy_bps_limit          = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_dd_blocksize            = 1M {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_name_template           = volume-%s {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_service_inithost_offload = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volume_usage_audit_period      = month {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] zoning_mode                    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_concurrency.disable_process_locking = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92204) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 17 04:01:09 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 17 04:01:09 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Running cmd (subprocess): mount.quobyte {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.admin_password = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.admin_token = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.admin_user  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_port   = 35357 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_protocol = https {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_section = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_type   = password {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_uri    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.auth_version = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.cache       = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.certfile    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.identity_uri = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.include_service_catalog = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.insecure    = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.interface   = public {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.keyfile     = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_password =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcache_username =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.region_name = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.service_token_roles_required = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.service_type = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.backend                  = dogpile.cache.null {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.backend_argument         = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.backend_expiration_time  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.config_prefix            = cache.oslo {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.debug_cache_backend      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.enable_retry_client      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.enable_socket_keepalive  = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.enabled                  = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.enforce_fips_mode        = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.expiration_time          = 600 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.hashclient_retry_attempts = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_dead_retry      = 300 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_pool_maxsize    = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_sasl_enabled    = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.password                 = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.proxies                  = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.redis_db                 = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.redis_server             = localhost:6379 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.retry_attempts           = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.retry_delay              = 0.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.socket_keepalive_count   = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.socket_keepalive_idle    = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.socket_keepalive_interval = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.socket_timeout           = 1.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.tls_allowed_ciphers      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.tls_cafile               = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.tls_certfile             = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.tls_enabled              = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.tls_keyfile              = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cache.username                 = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.asyncio_connection    = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.asyncio_slave_connection = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.backend               = sqlalchemy {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.connection            = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.connection_debug      = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.connection_parameters =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.connection_recycle_time = 3600 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.connection_trace      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.db_inc_retry_interval = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.db_max_retries        = 20 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.db_max_retry_interval = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.db_retry_interval     = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.max_overflow          = 50 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.max_pool_size         = 5 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.max_retries           = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.mysql_wsrep_sync_wait = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.pool_timeout          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.retry_interval        = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.slave_connection      = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.sqlite_synchronous    = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.synchronous_reader    = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] database.use_db_reconnect      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.connection_string     = messaging:// {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.enabled               = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.es_doc_type           = notification {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.es_scroll_size        = 10000 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.es_scroll_time        = 2m {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.filter_error_trace    = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.hmac_keys             = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.sentinel_service_name = mymaster {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.socket_timeout        = 0.1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.trace_requests        = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler.trace_sqlalchemy      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler_jaeger.process_tags   = {} {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler_jaeger.service_name_prefix = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] profiler_otlp.service_name_prefix = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.enforce_new_defaults = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: WARNING oslo_config.cfg [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.enforce_scope      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.policy_default_rule = default {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.policy_file        = policy.yaml {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] coordination.backend_url       = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.group          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.helper_command = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] privsep_osbrick.user           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.group         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.helper_command = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] cinder_sys_admin.user          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.auth_section      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.auth_type         = password {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.cafile            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.certfile          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.collect_timing    = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.insecure          = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.keyfile           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.send_service_user_token = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.split_loggers     = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] service_user.timeout           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.auth_section            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.auth_type               = password {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.certfile                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.collect_timing          = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.insecure                = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.keyfile                 = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.region_name             = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.split_loggers           = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] glance.timeout                 = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.backend_availability_zone = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.chap_password = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack quobyte-client[92219]: Reading configuration file: /etc/quobyte/client.cfg
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.chap_username =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.disk_geometry = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_client_cert = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_client_cert_key = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack quobyte-client[92219]: Invalid parameters found, error: missing mount point.
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_data_namespace = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack quobyte-client[92219]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:01:09 devstack quobyte-client[92219]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.driver_use_ssl = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.extra_capabilities = {} {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.filter_function = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.goodness_function = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iscsi_target_flags =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iscsi_write_cache = on {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iser_helper   = tgtadm {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iser_port     = 3260 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_host      =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_login     = admin {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_mount_options = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_password  = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_private_key =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_share_path =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.num_shell_tries = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:01:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.quobyte_volume_url = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.replication_device = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.report_discard_supported = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.reserved_percentage = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_helper = tgtadm {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_port   = 3260 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_protocol = iscsi {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.trace_flags   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.unique_fqdn_network = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.use_chap_auth = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_backend_name = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_clear  = zero {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_clear_ionice = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_clear_size = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_reports.file_event_handler = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_reports.log_dir           = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.backend_availability_zone = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.backend_host         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.chap_password        = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.chap_username        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.chiscsi_conf         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.disk_geometry        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_client_cert   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_data_namespace = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.driver_use_ssl       = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.extra_capabilities   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.filter_function      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.goodness_function    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iser_helper          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iser_ip_address      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iser_port            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.iser_target_prefix   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_host             = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_login            = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_mount_options    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_password         = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_private_key      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_share_path       = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_ssh_port         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.num_shell_tries      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.nvmet_port_id        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.replication_device   = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.report_discard_supported = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.reserved_percentage  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.scst_target_driver   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.storage_protocol     = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_helper        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_ip_address    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_port          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_prefix        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_protocol      = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.trace_flags          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.use_chap_auth        = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_clear         = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_clear_size    = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] QuobyteHD.volumes_dir          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl      = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_notifications.driver = [] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_notifications.retry = -1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] key_manager.fixed_key          = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.barbican_api_version  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.barbican_endpoint     = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.barbican_endpoint_type = public {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.barbican_region_name  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.cafile                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.certfile              = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.collect_timing        = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.insecure              = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.keyfile               = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.number_of_retries     = 60 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.retry_delay           = 1 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.send_service_user_token = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.split_loggers         = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.timeout               = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.verify_ssl            = True {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican.verify_ssl_path       = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.auth_section = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.auth_type = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.cafile   = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.certfile = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.collect_timing = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.insecure = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.keyfile  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.split_loggers = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] barbican_service_user.timeout  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.approle_role_id          = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.approle_secret_id        = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.kv_mountpoint            = secret {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.kv_path                  = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.kv_version               = 2 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.namespace                = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.root_token_id            = **** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.ssl_ca_crt_file          = None {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.timeout                  = 60.0 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.use_ssl                  = False {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 17 04:01:09 devstack cinder-volume[91909]: DEBUG oslo_service.backend._eventlet.service [None req-5b438a99-7896-4b46-bd82-e19fef70adcb None None] ******************************************************************************** {{(pid=91909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 17 04:01:10 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.882s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:01:10 devstack cinder-volume[92204]: INFO cinder.volume.driver [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Driver hasn't implemented _init_vendor_properties()
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG cinder.volume.driver [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92204) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_db.sqlalchemy.engines [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writer thread running {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG cinder.db.sqlalchemy.api [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Building query based on filter {{(pid=92204) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92204) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:01:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:01:10 devstack cinder-volume[92204]: INFO cinder.keymgr.migration [None req-818ecb9f-fd85-46f1-83df-f082d9d7fe6e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 17 04:01:10 devstack sudo[92266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:01:10 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:01:11 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.833s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:01:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Driver initialization completed successfully.
Jun 17 04:01:11 devstack cinder-volume[92204]: INFO cinder.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Initiating service 3 cleanup
Jun 17 04:01:11 devstack cinder-volume[92204]: INFO cinder.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Service 3 cleanup completed.
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG cinder.service [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Creating RPC server for service cinder-volume {{(pid=92204) start /opt/stack/cinder/cinder/service.py:231}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG cinder.service [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92204) start /opt/stack/cinder/cinder/service.py:237}}
Jun 17 04:01:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:01:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:01:11 devstack sudo[92276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:01:11 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:01:12 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root
Jun 17 04:01:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:01:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9824e991-5c42-4f14-88b0-92a4b5fe591e None None] Driver post RPC initialization completed successfully.
Jun 17 04:01:19 devstack cinder-volume[91909]: DEBUG dbcounter [-] [91909] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91909) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:01:21 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:01:22 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:02:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:02:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 6 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:02:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Flow 'volume_create_manager' (22f2b058-47d7-4332-95b1-8622fb9bbf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3175d980-9dfe-4168-bb76-3592c884e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3175d980-9dfe-4168-bb76-3592c884e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-96355286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157a4741-704b-43f6-939c-633986f60e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b6116327094f33b8065b6184fc370d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:33Z,use_quota=True,user_id='3fa9ffa56a594b1fba749c989ff325da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995d4087-cf06-4eeb-9cc2-fcf1bcbddae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995d4087-cf06-4eeb-9cc2-fcf1bcbddae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db53cfcb-4671-4920-95bd-13094125c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db53cfcb-4671-4920-95bd-13094125c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157a4741-704b-43f6-939c-633986f60e74', 'volume_name': 'volume-157a4741-704b-43f6-939c-633986f60e74', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3ef9a-9c3e-4982-8672-20e8aa0d063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3ef9a-9c3e-4982-8672-20e8aa0d063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb1aceb-fb42-481c-a96c-74d7984f51db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:32 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Volume 157a4741-704b-43f6-939c-633986f60e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157a4741-704b-43f6-939c-633986f60e74', 'volume_size': 1}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-96355286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157a4741-704b-43f6-939c-633986f60e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b6116327094f33b8065b6184fc370d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:33Z,use_quota=True,user_id='3fa9ffa56a594b1fba749c989ff325da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Creating volume 157a4741-704b-43f6-939c-633986f60e74 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:02:32 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:02:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:32 devstack sudo[92854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 1073741824
Jun 17 04:02:32 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:34 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 1073741824" returned: 0 in 2.020s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:35 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74
Jun 17 04:02:35 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Flow 'volume_create_manager' (d151854e-d572-41d5-9677-8349237d6f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6e0f28-dfd7-4920-b13b-121fa612dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6e0f28-dfd7-4920-b13b-121fa612dd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-522357731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc62b5-6e93-4fe5-b590-30f6470adff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffcc818eaa4578a3aacff314a67163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:35Z,use_quota=True,user_id='35e04abb10614a95bd55fdb803124a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ffebc4-9b7a-43be-8b2d-165d6cd2c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ffebc4-9b7a-43be-8b2d-165d6cd2c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799ba56d-5bb1-4864-911e-8e2fe0f3f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799ba56d-5bb1-4864-911e-8e2fe0f3f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcc62b5-6e93-4fe5-b590-30f6470adff7', 'volume_name': 'volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6b6e93-77a8-47b2-a1ba-95016407d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6b6e93-77a8-47b2-a1ba-95016407d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1841daef-e64f-49a7-a9c9-beec1348e753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Volume dbcc62b5-6e93-4fe5-b590-30f6470adff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7', 'volume_size': 1}
Jun 17 04:02:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:36 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74" returned: 0 in 1.522s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] <== create_volume: return (3705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.710s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-522357731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc62b5-6e93-4fe5-b590-30f6470adff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffcc818eaa4578a3aacff314a67163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:35Z,use_quota=True,user_id='35e04abb10614a95bd55fdb803124a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Creating volume dbcc62b5-6e93-4fe5-b590-30f6470adff7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:02:36 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb1aceb-fb42-481c-a96c-74d7984f51db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157a4741-704b-43f6-939c-633986f60e74', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:36 devstack sudo[93247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 1073741824
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ebc47-9d7e-4ef6-86c7-dd293fcf61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:36 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Volume volume-157a4741-704b-43f6-939c-633986f60e74 (157a4741-704b-43f6-939c-633986f60e74): created successfully
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ebc47-9d7e-4ef6-86c7-dd293fcf61e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Flow 'volume_create_manager' (22f2b058-47d7-4332-95b1-8622fb9bbf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:36 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-83d33a28-4ce6-46b6-bb0e-34aee0167086 tempest-DeleteServersTestJSON-1632400244 None] Created volume successfully.
Jun 17 04:02:38 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 1073741824" returned: 0 in 1.680s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:38 devstack sudo[93260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7
Jun 17 04:02:38 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:39 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7" returned: 0 in 1.051s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] <== create_volume: return (2805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.812s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1841daef-e64f-49a7-a9c9-beec1348e753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ef7e34-ee29-4b63-aeea-4f8136e30506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:39 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Volume volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 (dbcc62b5-6e93-4fe5-b590-30f6470adff7): created successfully
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ef7e34-ee29-4b63-aeea-4f8136e30506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Flow 'volume_create_manager' (d151854e-d572-41d5-9677-8349237d6f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ddb0ac92-6895-4693-8e58-36fa3f5f2689 tempest-VolumesAdminNegativeTest-1951936281 None] Created volume successfully.
Jun 17 04:02:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Acquiring lock "cinder-dbcc62b5-6e93-4fe5-b590-30f6470adff7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:02:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "cinder-dbcc62b5-6e93-4fe5-b590-30f6470adff7-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:02:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Acquiring lock "cinder-quobyte-dbcc62b5-6e93-4fe5-b590-30f6470adff7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:02:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "cinder-quobyte-dbcc62b5-6e93-4fe5-b590-30f6470adff7" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:02:41 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7cyzie0b/privsep.sock']
Jun 17 04:02:41 devstack sudo[93300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7cyzie0b/privsep.sock
Jun 17 04:02:41 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:44 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:44 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Spawned new privsep daemon via rootwrap
Jun 17 04:02:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Accepted privsep connection to /tmp/tmp7cyzie0b/privsep.sock {{(pid=92204) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 17 04:02:44 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 17 04:02:44 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 17 04:02:44 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 17 04:02:44 devstack cinder-volume[92204]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93309
Jun 17 04:02:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b897a9-9c24-4d84-bd04-e421441954bf]: (2,) {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:02:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd20baf-537d-48d9-abf4-72d028004843]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:02:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:45 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7
Jun 17 04:02:45 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:46 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7" returned: 0 in 1.576s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:46 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7
Jun 17 04:02:46 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:48 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-dbcc62b5-6e93-4fe5-b590-30f6470adff7" returned: 0 in 1.841s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "cinder-quobyte-dbcc62b5-6e93-4fe5-b590-30f6470adff7" released by "delete_volume" :: held 6.646s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Flow 'volume_create_manager' (7f53ace5-b102-4a57-a1ea-c3b785a201f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581ae563-7b86-42a2-9e7b-6c62c7c4210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:48 devstack cinder-volume[92204]: WARNING py.warnings [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jun 17 04:02:48 devstack cinder-volume[92204]:   .first()
Jun 17 04:02:48 devstack cinder-volume[92204]: 
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581ae563-7b86-42a2-9e7b-6c62c7c4210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-341473483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b964220b-53e9-4146-8e8b-17211e2bf18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bafe7fde4d4403b8df8b82c5b47e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:48Z,use_quota=True,user_id='15e74a5aa58b4a8f89588eac458953a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76134786-42f7-4b6d-80f3-013eb2c24ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76134786-42f7-4b6d-80f3-013eb2c24ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f3b3a-2f66-4e3e-9be3-11273ecfab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f3b3a-2f66-4e3e-9be3-11273ecfab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b964220b-53e9-4146-8e8b-17211e2bf18e', 'volume_name': 'volume-b964220b-53e9-4146-8e8b-17211e2bf18e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7786dd6f-4592-434c-b971-677dc887e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7786dd6f-4592-434c-b971-677dc887e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d404a6b-f221-49f6-a266-83e3f4e5f2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:48 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Volume b964220b-53e9-4146-8e8b-17211e2bf18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b964220b-53e9-4146-8e8b-17211e2bf18e', 'volume_size': 1}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-341473483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b964220b-53e9-4146-8e8b-17211e2bf18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bafe7fde4d4403b8df8b82c5b47e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:02:48Z,use_quota=True,user_id='15e74a5aa58b4a8f89588eac458953a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Creating volume b964220b-53e9-4146-8e8b-17211e2bf18e {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:02:48 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:48 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e 1073741824
Jun 17 04:02:48 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:48 devstack cinder-volume[92204]: WARNING cinder.quota [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:02:48 devstack cinder-volume[92204]: WARNING cinder.quota [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:02:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Created reservations ['134f93ec-af9c-4e6f-8581-1900af6a0025', 'd52bfed1-9a0e-44c6-9b61-d2a4d7800509', '4c09b574-e8c1-450f-b7bd-6a6a727935d7', '5f8a5cee-d68d-4408-9ffa-4fc818c441b8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:49 devstack sudo[93353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:02:49 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:50 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e 1073741824" returned: 0 in 1.762s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:50 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.421s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:50 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:02:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Deleted volume successfully.
Jun 17 04:02:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0a53544e-95b0-4b19-8191-d92bbb63b1c5 tempest-VolumesAdminNegativeTest-1951936281 None] Lock "cinder-dbcc62b5-6e93-4fe5-b590-30f6470adff7-delete_volume" released by "delete_volume" :: held 8.909s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:02:50 devstack sudo[93361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e
Jun 17 04:02:50 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:51 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e" returned: 0 in 0.939s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.873s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.791s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d404a6b-f221-49f6-a266-83e3f4e5f2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b964220b-53e9-4146-8e8b-17211e2bf18e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6dd35c-e30c-4baa-bd45-340896578373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a383d-5e49-432b-9073-2a437b26b749]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:02:51 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Volume volume-b964220b-53e9-4146-8e8b-17211e2bf18e (b964220b-53e9-4146-8e8b-17211e2bf18e): created successfully
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6dd35c-e30c-4baa-bd45-340896578373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:02:51 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Flow 'volume_create_manager' (7f53ace5-b102-4a57-a1ea-c3b785a201f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:02:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fd76bc72-2214-472b-b7be-92c449f69137 tempest-ServerRescueNegativeTestJSON-1248924574 None] Created volume successfully.
Jun 17 04:02:52 devstack sudo[93364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74
Jun 17 04:02:52 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:02:53 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root
Jun 17 04:02:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74" returned: 0 in 1.595s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:02:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.658s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:02:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-157a4741-704b-43f6-939c-633986f60e74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9db3afd-5114-4fa3-b8aa-950f30dbb804', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:02:53 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-7974607e-861e-4a18-a929-6370ec8f0103 req-60b782d2-1241-4905-aa1b-c49913a9a0d3 tempest-DeleteServersTestJSON-1632400244 None] attachment_update completed successfully.
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:02 devstack sudo[93942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:03:02 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=4 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:03:03 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.326s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:03:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-a31a348a-290d-4df3-8eec-abc52b8c78b4 req-7ff9da8a-ece8-4e3e-bb66-496d45a6ce60 tempest-DeleteServersTestJSON-1632400244 None] Terminate volume connection completed successfully.
Jun 17 04:03:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-a31a348a-290d-4df3-8eec-abc52b8c78b4 req-7ff9da8a-ece8-4e3e-bb66-496d45a6ce60 tempest-DeleteServersTestJSON-1632400244 None] Deleting attachment f9db3afd-5114-4fa3-b8aa-950f30dbb804. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "cinder-157a4741-704b-43f6-939c-633986f60e74-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "cinder-157a4741-704b-43f6-939c-633986f60e74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "cinder-quobyte-157a4741-704b-43f6-939c-633986f60e74" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "cinder-quobyte-157a4741-704b-43f6-939c-633986f60e74" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57df94c-844c-49ff-988f-822161b3cd77]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:03:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:08 devstack sudo[94015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74
Jun 17 04:03:08 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:09 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74" returned: 0 in 0.895s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:09 devstack sudo[94051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74
Jun 17 04:03:09 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:10 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-157a4741-704b-43f6-939c-633986f60e74" returned: 0 in 0.980s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "cinder-quobyte-157a4741-704b-43f6-939c-633986f60e74" released by "delete_volume" :: held 1.960s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Created reservations ['5af4a9fb-29a3-41ca-85b4-cac1b03f92b0', '559b414a-dbeb-4c6f-8091-0450d2d84bce', '9436b5a2-a958-4474-a454-9860d6cfd99a', 'feefa40b-7cb9-45f9-98eb-f4c1081af886'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:10 devstack sudo[94086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:03:10 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:11 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.817s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:11 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:03:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Deleted volume successfully.
Jun 17 04:03:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d8ce9a8-9d04-4687-998e-682402b9b4db tempest-DeleteServersTestJSON-1632400244 None] Lock "cinder-157a4741-704b-43f6-939c-633986f60e74-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Acquiring lock "cinder-b964220b-53e9-4146-8e8b-17211e2bf18e-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "cinder-b964220b-53e9-4146-8e8b-17211e2bf18e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Acquiring lock "cinder-quobyte-b964220b-53e9-4146-8e8b-17211e2bf18e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "cinder-quobyte-b964220b-53e9-4146-8e8b-17211e2bf18e" acquired by "delete_volume" :: waited 0.043s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edf2b7-13f1-4520-9dfe-4ac27c16bbf6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:03:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:16 devstack sudo[94140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e
Jun 17 04:03:16 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:17 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e" returned: 0 in 1.245s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:17 devstack sudo[94146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e
Jun 17 04:03:17 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:18 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b964220b-53e9-4146-8e8b-17211e2bf18e" returned: 0 in 0.968s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "cinder-quobyte-b964220b-53e9-4146-8e8b-17211e2bf18e" released by "delete_volume" :: held 2.283s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Created reservations ['7170d9dc-4dfb-4ea5-b7a7-ea74bda824da', '75a2a938-ea85-4c57-9702-dfb17d6e4415', 'dbacd6d3-70ff-424d-bc37-fb2f4abf3948', '2b5c008e-2e20-470a-9ab1-fc1584c41b4a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:18 devstack sudo[94149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:03:18 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:19 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.044s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:19 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:03:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Deleted volume successfully.
Jun 17 04:03:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b146725c-7438-472b-b99b-66e0f52f84ca tempest-ServerRescueNegativeTestJSON-1248924574 None] Lock "cinder-b964220b-53e9-4146-8e8b-17211e2bf18e-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:03:28 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=10,cinder:UPDATE=18,cinder:INSERT=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:03:29 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Flow 'volume_create_manager' (8d93f637-6c2c-4ce4-b308-0c5bb1b578ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82d6037-d508-42cd-afe8-c4a45883550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82d6037-d508-42cd-afe8-c4a45883550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1987467550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd10665-7ab9-4b48-8fa0-0056e1c53ea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2105cb4c66b148ba90d955043ef33a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:03:55Z,use_quota=True,user_id='a946f9e8c7974e4f94b49ee35d8f7a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5df3322-9532-4656-970b-7a35c97b6246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5df3322-9532-4656-970b-7a35c97b6246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f968d9d7-5250-44a9-a0af-10c024753038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f968d9d7-5250-44a9-a0af-10c024753038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd10665-7ab9-4b48-8fa0-0056e1c53ea3', 'volume_name': 'volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0a0f43-f322-4f1b-8d09-39ff61d41be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0a0f43-f322-4f1b-8d09-39ff61d41be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874ce0d9-12db-41b1-b1dd-bc91bbd04261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Volume 9bd10665-7ab9-4b48-8fa0-0056e1c53ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3', 'volume_size': 1}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1987467550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd10665-7ab9-4b48-8fa0-0056e1c53ea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2105cb4c66b148ba90d955043ef33a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:03:55Z,use_quota=True,user_id='a946f9e8c7974e4f94b49ee35d8f7a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Creating volume 9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:03:55 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:03:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:55 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 1073741824
Jun 17 04:03:55 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:56 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 1073741824" returned: 0 in 1.093s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:56 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3
Jun 17 04:03:56 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:56 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:03:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Flow 'volume_create_manager' (501d0884-5485-4b48-902f-024353da5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:03:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7f5c57-d852-43bc-943a-8e703a54aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7f5c57-d852-43bc-943a-8e703a54aca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-123010443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7793824-e605-4e40-9ca8-f570cbe89e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a680a4aaf4bcfbf1012566d742cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:03:57Z,use_quota=True,user_id='82a21b3bee8f4fd59f3a50944d612fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1019559-172d-4d5c-b63c-c35b6d5cd418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1019559-172d-4d5c-b63c-c35b6d5cd418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c78d3-5bcd-4212-9406-eaa21d75dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c78d3-5bcd-4212-9406-eaa21d75dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7793824-e605-4e40-9ca8-f570cbe89e01', 'volume_name': 'volume-e7793824-e605-4e40-9ca8-f570cbe89e01', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dd97d0-088d-488b-b58c-e885d8fd4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dd97d0-088d-488b-b58c-e885d8fd4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a1a35-f721-4886-80b0-cdeb9dcae4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Volume e7793824-e605-4e40-9ca8-f570cbe89e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7793824-e605-4e40-9ca8-f570cbe89e01', 'volume_size': 1}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:57 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" returned: 0 in 0.672s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-123010443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7793824-e605-4e40-9ca8-f570cbe89e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a680a4aaf4bcfbf1012566d742cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:03:57Z,use_quota=True,user_id='82a21b3bee8f4fd59f3a50944d612fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Creating volume e7793824-e605-4e40-9ca8-f570cbe89e01 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:03:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874ce0d9-12db-41b1-b1dd-bc91bbd04261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d72eb0c-bb29-412e-86ad-2cc42e84216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:57 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 1073741824
Jun 17 04:03:57 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Volume volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 (9bd10665-7ab9-4b48-8fa0-0056e1c53ea3): created successfully
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d72eb0c-bb29-412e-86ad-2cc42e84216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Flow 'volume_create_manager' (8d93f637-6c2c-4ce4-b308-0c5bb1b578ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:03:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-3603c026-ca0c-4cdb-92a1-9f9f0e1d1945 req-46cf82dd-33a0-42bd-9e46-7797df32d704 tempest-VolumesGetTestJSON-938002387 None] Created volume successfully.
Jun 17 04:03:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Acquiring lock "cinder-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "cinder-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Acquiring lock "cinder-quobyte-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "cinder-quobyte-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[661443c9-5e1e-40b4-8506-cf381f38915c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:58 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3
Jun 17 04:03:58 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:58 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 1073741824" returned: 0 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:58 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01
Jun 17 04:03:58 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:58 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" returned: 0 in 0.739s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:58 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3
Jun 17 04:03:58 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:03:58 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a1a35-f721-4886-80b0-cdeb9dcae4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7793824-e605-4e40-9ca8-f570cbe89e01', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6ce021-0f00-4955-8c9a-82216186bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:03:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Volume volume-e7793824-e605-4e40-9ca8-f570cbe89e01 (e7793824-e605-4e40-9ca8-f570cbe89e01): created successfully
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6ce021-0f00-4955-8c9a-82216186bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Flow 'volume_create_manager' (501d0884-5485-4b48-902f-024353da5e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:03:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-baf69d23-1464-467a-8445-abe0cfe415b8 tempest-TaggedAttachmentsTest-1983686342 None] Created volume successfully.
Jun 17 04:03:59 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" returned: 0 in 0.624s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "cinder-quobyte-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3" released by "delete_volume" :: held 1.410s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.quota [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Created reservations ['9618feab-826d-4999-a2e7-9cb7326b4b8c', '2dafa776-83b1-44e6-b558-331062f2c77a', 'eea5271c-8562-41dc-a0bb-5a99b93cc789', '3e2c17b5-944d-4204-9f98-3299b8cabfcb'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:03:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:03:59 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:03:59 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:00 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.596s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:00 devstack cinder-volume[92204]: DEBUG cinder.manager [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Deleted volume successfully.
Jun 17 04:04:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-e852bc17-b035-4bc3-a3e7-c67627eb5a29 req-697658dd-0f2b-48d5-b798-e5807b8bb628 tempest-VolumesGetTestJSON-938002387 None] Lock "cinder-9bd10665-7ab9-4b48-8fa0-0056e1c53ea3-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:02 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:04:02 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:03 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.998s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:09 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=4 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:04:10 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:04:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-47fb699a-edd7-4460-af6a-31858b9abbb0 tempest-BackendsCapabilitiesAdminTestsJSON-1338599229 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 17 04:04:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-50bfeca5-5354-4dc5-80ab-4465412aa078 tempest-BackendsCapabilitiesAdminTestsJSON-1338599229 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 17 04:04:15 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Flow 'volume_create_manager' (64e57cb4-6290-4d36-9096-c1853ad95e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59448ee7-feb4-4bb2-8d3e-ae4cbbdaca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59448ee7-feb4-4bb2-8d3e-ae4cbbdaca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1523679758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0098ffbd-d2c0-4706-bff7-2276f147ba12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25839537b7fb45429a6a177a8d58043c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:16Z,use_quota=True,user_id='863f85e567d14215834694b4556b8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66264899-38ae-4910-8854-055b54ff5456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66264899-38ae-4910-8854-055b54ff5456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f778c-ca71-4e2d-b6f2-7d895a110610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f778c-ca71-4e2d-b6f2-7d895a110610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0098ffbd-d2c0-4706-bff7-2276f147ba12', 'volume_name': 'volume-0098ffbd-d2c0-4706-bff7-2276f147ba12', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c9463b-f703-409b-9889-491c19b6045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c9463b-f703-409b-9889-491c19b6045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57358405-2117-4fac-8c79-2bbaf40a283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:16 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Volume 0098ffbd-d2c0-4706-bff7-2276f147ba12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0098ffbd-d2c0-4706-bff7-2276f147ba12', 'volume_size': 1}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1523679758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0098ffbd-d2c0-4706-bff7-2276f147ba12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25839537b7fb45429a6a177a8d58043c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:16Z,use_quota=True,user_id='863f85e567d14215834694b4556b8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Creating volume 0098ffbd-d2c0-4706-bff7-2276f147ba12 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:16 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:16 devstack sudo[94631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 1073741824
Jun 17 04:04:16 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:17 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 1073741824" returned: 0 in 0.978s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:17 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12
Jun 17 04:04:17 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:17 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12" returned: 0 in 0.939s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57358405-2117-4fac-8c79-2bbaf40a283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0098ffbd-d2c0-4706-bff7-2276f147ba12', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc7daf-f36f-4e8e-9472-7b7ab4462b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Volume volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 (0098ffbd-d2c0-4706-bff7-2276f147ba12): created successfully
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc7daf-f36f-4e8e-9472-7b7ab4462b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Flow 'volume_create_manager' (64e57cb4-6290-4d36-9096-c1853ad95e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:18 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-afd183d2-2e9f-4be4-b47b-e8df229b9766 tempest-ServersNegativeTestJSON-1341450155 None] Created volume successfully.
Jun 17 04:04:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-894eff88-397d-41ff-bbdd-b6189e8c8cf3 tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-162573935: creating
Jun 17 04:04:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-894eff88-397d-41ff-bbdd-b6189e8c8cf3 tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-162573935: created successfully
Jun 17 04:04:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-894eff88-397d-41ff-bbdd-b6189e8c8cf3 tempest-GroupSnapshotsTest-1186892099 None] Create group completed successfully.
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Flow 'volume_create_manager' (ddd71a4c-1dca-411b-af92-22cd68a68827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a06d0e-fa59-4394-a6a5-214040c0a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a06d0e-fa59-4394-a6a5-214040c0a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2013944272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a58cc63-ace8-4ffa-b890-4e3486fc6a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25839537b7fb45429a6a177a8d58043c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:22Z,use_quota=True,user_id='863f85e567d14215834694b4556b8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b5fd2-8d19-429d-b6d4-de72e3a448ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b5fd2-8d19-429d-b6d4-de72e3a448ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec3be8-0f67-4e8a-8706-119540948578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec3be8-0f67-4e8a-8706-119540948578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a58cc63-ace8-4ffa-b890-4e3486fc6a3a', 'volume_name': 'volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c47167-521f-4818-a249-0623249e3d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c47167-521f-4818-a249-0623249e3d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4dc466-8e80-4ab3-9dc1-8ba09e02e1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Volume 0a58cc63-ace8-4ffa-b890-4e3486fc6a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a', 'volume_size': 1}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2013944272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a58cc63-ace8-4ffa-b890-4e3486fc6a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25839537b7fb45429a6a177a8d58043c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:22Z,use_quota=True,user_id='863f85e567d14215834694b4556b8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Creating volume 0a58cc63-ace8-4ffa-b890-4e3486fc6a3a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:21 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:21 devstack sudo[94730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a 1073741824
Jun 17 04:04:21 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (0e78cd4e-b262-4ad2-8208-4797972bc3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc568aba-c871-407a-b89d-26be998528a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc568aba-c871-407a-b89d-26be998528a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018421897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f78e4da2-ca5f-4492-bd00-86616d8e5a86,host='devstack@QuobyteHD#QuobyteHD',id=89b6744b-12d4-414a-a09e-360c6bb984e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:22Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e811df25-a08f-4911-9c4e-1b069649c5fb),volume_type_id=e811df25-a08f-4911-9c4e-1b069649c5fb)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9036136-3fe7-475c-8a49-d7235d6c4426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9036136-3fe7-475c-8a49-d7235d6c4426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a664467-05a4-4efc-bdc7-19ad8c79e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a664467-05a4-4efc-bdc7-19ad8c79e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b6744b-12d4-414a-a09e-360c6bb984e0', 'volume_name': 'volume-89b6744b-12d4-414a-a09e-360c6bb984e0', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b072e52-f1ca-4b6d-8905-66f45358153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b072e52-f1ca-4b6d-8905-66f45358153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb391a5b-1034-4dfb-bf6a-af2ce875d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Volume 89b6744b-12d4-414a-a09e-360c6bb984e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b6744b-12d4-414a-a09e-360c6bb984e0', 'volume_size': 1}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a 1073741824" returned: 0 in 0.979s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:22 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:22 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a
Jun 17 04:04:22 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:23 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" returned: 0 in 0.798s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f78e4da2-ca5f-4492-bd00-86616d8e5a86,created_at=2026-06-17T02:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018421897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f78e4da2-ca5f-4492-bd00-86616d8e5a86,host='devstack@QuobyteHD#QuobyteHD',id=89b6744b-12d4-414a-a09e-360c6bb984e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:22Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e811df25-a08f-4911-9c4e-1b069649c5fb),volume_type_id=e811df25-a08f-4911-9c4e-1b069649c5fb)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Creating volume 89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:23 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4dc466-8e80-4ab3-9dc1-8ba09e02e1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:23 devstack sudo[94741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 1073741824
Jun 17 04:04:23 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad4bb84-1e80-4f86-af31-526b0243aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Volume volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a (0a58cc63-ace8-4ffa-b890-4e3486fc6a3a): created successfully
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad4bb84-1e80-4f86-af31-526b0243aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Flow 'volume_create_manager' (ddd71a4c-1dca-411b-af92-22cd68a68827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-61c75b9d-3547-4607-ae4b-a36420cd3687 tempest-ServersNegativeTestJSON-1341450155 None] Created volume successfully.
Jun 17 04:04:25 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 1073741824" returned: 0 in 1.224s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:25 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:25 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "cinder-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:25 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "cinder-quobyte-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb391a5b-1034-4dfb-bf6a-af2ce875d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b6744b-12d4-414a-a09e-360c6bb984e0', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60a4682-2e58-471f-ac20-9c0ec4f0d7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-quobyte-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Volume volume-89b6744b-12d4-414a-a09e-360c6bb984e0 (89b6744b-12d4-414a-a09e-360c6bb984e0): created successfully
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60a4682-2e58-471f-ac20-9c0ec4f0d7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (0e78cd4e-b262-4ad2-8208-4797972bc3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[030bc51d-e2e2-48a7-8185-80125d5ecab3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-eee27334-31f0-438b-8810-9a0955ed9556 tempest-GroupSnapshotsTest-1186892099 None] Created volume successfully.
Jun 17 04:04:26 devstack sudo[94774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a
Jun 17 04:04:26 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:26 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" returned: 0 in 0.749s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:26 devstack sudo[94780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a
Jun 17 04:04:26 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] GroupSnapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: creating.
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Group snapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: creating. {{(pid=92204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Creating offline snapshot 69d50ea4-d461-4b62-b31e-02d7acd36450 of volume 89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0333ff40-5ecc-4df5-87f8-0810bb76d59b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:27 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:27 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:27 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-quobyte-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a" released by "delete_volume" :: held 1.545s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Created reservations ['5ba8a083-b38b-4de9-a742-8eb17fbbfb8e', 'afc5f4ae-2182-4a45-bf36-35c68633db81', '9a8843c1-0320-4894-8a6a-bde5df46f5db', 'e8f39898-a95d-41d8-aef6-f52eeb5558f7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:27 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:04:27 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:28 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.750s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:28 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 1G
Jun 17 04:04:28 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "cinder-0098ffbd-d2c0-4706-bff7-2276f147ba12-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-0098ffbd-d2c0-4706-bff7-2276f147ba12-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "cinder-quobyte-0098ffbd-d2c0-4706-bff7-2276f147ba12" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:28 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-quobyte-0098ffbd-d2c0-4706-bff7-2276f147ba12" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Deleted volume successfully.
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58e34c-2001-4a75-ae9a-4a48659c73b2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-11b5d60e-c743-48f0-8043-afd5b0555970 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-0a58cc63-ace8-4ffa-b890-4e3486fc6a3a-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:28 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12
Jun 17 04:04:28 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:28 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 1G" returned: 0 in 0.851s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b6744b-12d4-414a-a09e-360c6bb984e0 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:28 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b6744b-12d4-414a-a09e-360c6bb984e0 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:28 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:29 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:29 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12
Jun 17 04:04:29 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:29 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b6744b-12d4-414a-a09e-360c6bb984e0 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.738s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:29 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:29 devstack sudo[94810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:29 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:29 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0098ffbd-d2c0-4706-bff7-2276f147ba12" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-quobyte-0098ffbd-d2c0-4706-bff7-2276f147ba12" released by "delete_volume" :: held 1.415s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Created reservations ['9ffd4f44-4501-4b28-94d0-0c757daa0a3d', '58ea4b0a-acc6-4b3d-9832-65f5a8bcc634', 'fb201ccd-453b-483d-8870-4a45d2f1401a', '17f93606-7eaf-4fc5-b72d-847782f324f6'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:29 devstack sudo[94812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:04:29 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:30 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.614s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:30 devstack sudo[94815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info
Jun 17 04:04:30 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:30 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:30 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Deleted volume successfully.
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f4e156ee-d49a-4958-a0fc-8c8205869404 tempest-ServersNegativeTestJSON-1341450155 None] Lock "cinder-0098ffbd-d2c0-4706-bff7-2276f147ba12-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:30 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:30 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:04:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:30 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info
Jun 17 04:04:30 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:31 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.info" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.438s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ad59734a-8043-4e81-9e80-c1aba5b24ca5 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: created successfully
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450-790f377e-772f-4eb4-8b76-c9977f7951f5" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450-790f377e-772f-4eb4-8b76-c9977f7951f5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Creating volume 790f377e-772f-4eb4-8b76-c9977f7951f5 from snapshot 69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] snapshot: 69d50ea4-d461-4b62-b31e-02d7acd36450, volume: 790f377e-772f-4eb4-8b76-c9977f7951f5,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7354cae-2bed-471b-bcbf-bdc72a6c3945]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:34 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:34 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:35 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.847s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b6744b-12d4-414a-a09e-360c6bb984e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ed639-4207-4458-927f-770f3b5da16a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:35 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:35 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:36 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.809s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:36 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5
Jun 17 04:04:36 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Flow 'volume_create_manager' (b706e1af-90ed-4ae1-b71e-eee4f8bb6ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282922e5-eaba-4f5e-b0f5-d7d5a9b187f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282922e5-eaba-4f5e-b0f5-d7d5a9b187f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-364871693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bb688c-1a01-4754-b160-ef483c36bd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c71fa13bd147baa9d09573f3b82977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:36Z,use_quota=True,user_id='562f40d2b13d4a1185584aaa6898560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c212f369-e242-483e-bf94-149c247be3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c212f369-e242-483e-bf94-149c247be3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2996c52-7be9-4c71-8108-75f1799c1a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2996c52-7be9-4c71-8108-75f1799c1a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bb688c-1a01-4754-b160-ef483c36bd2a', 'volume_name': 'volume-96bb688c-1a01-4754-b160-ef483c36bd2a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8c60ae-fea3-42fc-9d17-3be2b940de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8c60ae-fea3-42fc-9d17-3be2b940de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa32706-e9bd-4b50-bb06-55237503dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Volume 96bb688c-1a01-4754-b160-ef483c36bd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bb688c-1a01-4754-b160-ef483c36bd2a', 'volume_size': 1}
Jun 17 04:04:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:41 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5" returned: 0 in 5.750s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[83234168-8f54-4a3d-9f95-582785e16496]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:42 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:42 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:42 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 1.000s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:42 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:04:42 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Converted 1024.00 MB image at 178.04 MB/s
Jun 17 04:04:42 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:04:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:43 devstack sudo[94970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5
Jun 17 04:04:43 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:43 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" released by "_copy_volume_from_snapshot" :: held 9.265s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450-790f377e-772f-4eb4-8b76-c9977f7951f5" released by "_create_volume_from_snapshot" :: held 9.311s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.333s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.352s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-364871693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bb688c-1a01-4754-b160-ef483c36bd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c71fa13bd147baa9d09573f3b82977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:36Z,use_quota=True,user_id='562f40d2b13d4a1185584aaa6898560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Creating volume 96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:43 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:43 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a 1073741824
Jun 17 04:04:43 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ec0afca3-e8f0-4251-aed3-d70bdb5f493b tempest-GroupSnapshotsTest-1186892099 None] Create group from source-snapshot-ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1 completed successfully.
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[804044dc-c0a3-4b02-9eaf-9b7373242fb4]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:44 devstack sudo[94979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5
Jun 17 04:04:44 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:44 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a 1073741824" returned: 0 in 1.168s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:44 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a
Jun 17 04:04:44 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:45 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5" returned: 0 in 0.872s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:45 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5
Jun 17 04:04:45 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:45 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a" returned: 0 in 0.727s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa32706-e9bd-4b50-bb06-55237503dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bb688c-1a01-4754-b160-ef483c36bd2a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995fef51-c8f0-4d5a-b3ec-5017a521db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:45 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Volume volume-96bb688c-1a01-4754-b160-ef483c36bd2a (96bb688c-1a01-4754-b160-ef483c36bd2a): created successfully
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995fef51-c8f0-4d5a-b3ec-5017a521db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Flow 'volume_create_manager' (b706e1af-90ed-4ae1-b71e-eee4f8bb6ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:45 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1c05af2e-f4ae-4362-ab2a-980a4cf07cc1 tempest-ServerActionsTestOtherA-1125359793 None] Created volume successfully.
Jun 17 04:04:46 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-790f377e-772f-4eb4-8b76-c9977f7951f5" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-790f377e-772f-4eb4-8b76-c9977f7951f5" released by "delete_volume" :: held 1.579s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['bef69c82-f993-41ca-b904-7374eb16a1cc'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:46 devstack cinder-volume[92204]: WARNING cinder.quota [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1949912147 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1949912147, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:04:46 devstack cinder-volume[92204]: WARNING cinder.quota [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1949912147 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1949912147, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['e4311f05-e903-4f81-ae6d-387f436492f0', '98cf3e23-5b6c-40fa-b8f2-209f40603571', '5f867952-5691-4fe5-8f29-e873b15c61e1', 'a0d50c3e-b87d-4e9e-8e8c-a739863c9d7d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:46 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:04:46 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: deleting
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: deleting {{(pid=92204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Deleting offline snapshot 69d50ea4-d461-4b62-b31e-02d7acd36450 of volume 89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] snapshot_file for this snap is: volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:04:47 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4e46a-58db-4dba-aff9-0418919e2dec]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.860s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:47 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-109ae949-a9de-4bf9-b503-688306160974 tempest-GroupSnapshotsTest-1186892099 None] Delete group completed successfully.
Jun 17 04:04:47 devstack sudo[94998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:47 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:48 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.909s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b6744b-12d4-414a-a09e-360c6bb984e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:04:48 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f1c312-529b-49fb-9617-7c1cda69f571]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:48 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:48 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:49 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.798s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:49 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:49 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:49 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.814s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:49 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450
Jun 17 04:04:49 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:50 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0.69d50ea4-d461-4b62-b31e-02d7acd36450" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-69d50ea4-d461-4b62-b31e-02d7acd36450" released by "_delete_snapshot" :: held 3.375s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" released by "delete_snapshot" :: held 3.413s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:50 devstack cinder-volume[92204]: WARNING cinder.quota [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1949912147 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1949912147, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:04:50 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['232f4f4f-1c27-4603-9131-35faceaf0add', '5159bbb6-acae-44e5-99e4-5d9f6df720cb', 'ec006541-b976-408c-840e-322896d0e48d', '5450af5b-2c69-4aa9-b8cd-e9ac9dbfd91d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-85f11c37-3658-4d3a-8350-b46bda17b9b7 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ac9b4526-b150-4c5c-96a5-9b8dd7b55ff1: deleted successfully
Jun 17 04:04:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:04:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:04:51 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b64ddd-961e-433b-9162-778d2d08ffb1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:04:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:52 devstack sudo[95035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:52 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:52 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.816s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:52 devstack sudo[95040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0
Jun 17 04:04:52 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:53 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-89b6744b-12d4-414a-a09e-360c6bb984e0" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-89b6744b-12d4-414a-a09e-360c6bb984e0" released by "delete_volume" :: held 1.630s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['10eabba3-5441-4c3d-9f23-3330a994aa94'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:53 devstack cinder-volume[92204]: WARNING cinder.db.sqlalchemy.api [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1949912147']
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['8c0647d9-960a-4625-a690-3052b4f4d5a8', '50c01395-d07e-4015-a3b2-94fd7dad0d80', '70050344-07d3-40ed-be33-6c5cbb01ef93', '7dd030dc-80a4-4195-ab44-ca8fdcaff021'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:53 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:04:53 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:54 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.972s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:54 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:04:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-49612a49-54a6-4b14-b7a0-96ad90925de7 tempest-GroupSnapshotsTest-1186892099 None] Delete group completed successfully.
Jun 17 04:04:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-614832d7-05ad-46c1-a6a1-1f8f3a55e8cb tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-402539992: creating
Jun 17 04:04:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-614832d7-05ad-46c1-a6a1-1f8f3a55e8cb tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-402539992: created successfully
Jun 17 04:04:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-614832d7-05ad-46c1-a6a1-1f8f3a55e8cb tempest-GroupSnapshotsTest-1186892099 None] Create group completed successfully.
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (24b62495-97ad-49e5-ba90-70d34ad86aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74aad3c4-4da6-440b-a466-698cd5108b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74aad3c4-4da6-440b-a466-698cd5108b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-842464444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,host='devstack@QuobyteHD#QuobyteHD',id=a2a39a72-8eb5-44b7-ba74-62639eba1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:57Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c448d4b9-f84e-4487-be34-d543499427f9),volume_type_id=c448d4b9-f84e-4487-be34-d543499427f9)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1031bff8-d964-46a3-b1cc-7e916814fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1031bff8-d964-46a3-b1cc-7e916814fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f299f3d5-eb89-4023-b514-98c0d7ed5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f299f3d5-eb89-4023-b514-98c0d7ed5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a39a72-8eb5-44b7-ba74-62639eba1e17', 'volume_name': 'volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84287957-6577-4ae8-bea0-69ae773b15ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84287957-6577-4ae8-bea0-69ae773b15ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9935fe07-45ca-40dc-a0ec-9f60b68ead2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Volume a2a39a72-8eb5-44b7-ba74-62639eba1e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17', 'volume_size': 1}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,created_at=2026-06-17T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-842464444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,host='devstack@QuobyteHD#QuobyteHD',id=a2a39a72-8eb5-44b7-ba74-62639eba1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:04:57Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c448d4b9-f84e-4487-be34-d543499427f9),volume_type_id=c448d4b9-f84e-4487-be34-d543499427f9)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Creating volume a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:57 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 1073741824
Jun 17 04:04:57 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:58 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 1073741824" returned: 0 in 1.152s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:58 devstack sudo[95157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17
Jun 17 04:04:58 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:04:59 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17" returned: 0 in 0.645s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9935fe07-45ca-40dc-a0ec-9f60b68ead2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19334e7a-6330-4c45-8101-19d96910b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Volume volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 (a2a39a72-8eb5-44b7-ba74-62639eba1e17): created successfully
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19334e7a-6330-4c45-8101-19d96910b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (24b62495-97ad-49e5-ba90-70d34ad86aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2cf8d996-e1b4-413c-b99b-639168502f53 tempest-GroupSnapshotsTest-1186892099 None] Created volume successfully.
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (926e1ebd-3098-4f6f-a3bc-6c69fce1f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab42a4-71d6-4740-8a0f-216e3ba1ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab42a4-71d6-4740-8a0f-216e3ba1ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941256819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,host='devstack@QuobyteHD#QuobyteHD',id=7864ba36-b70a-497a-a4af-34165e305150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:00Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c448d4b9-f84e-4487-be34-d543499427f9),volume_type_id=c448d4b9-f84e-4487-be34-d543499427f9)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f819cb2a-434c-44d8-8b3a-99deb3c989a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f819cb2a-434c-44d8-8b3a-99deb3c989a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001243cf-5424-4805-8b6e-05034d0764fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001243cf-5424-4805-8b6e-05034d0764fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7864ba36-b70a-497a-a4af-34165e305150', 'volume_name': 'volume-7864ba36-b70a-497a-a4af-34165e305150', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebad05c-2909-45ef-8ac9-ef9d86f49ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebad05c-2909-45ef-8ac9-ef9d86f49ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85c237-1f77-4cbd-99ca-c83cf33bd2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:04:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Volume 7864ba36-b70a-497a-a4af-34165e305150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7864ba36-b70a-497a-a4af-34165e305150', 'volume_size': 1}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,created_at=2026-06-17T02:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941256819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3187c3a-e8d9-4b60-ac2a-65973b252751,host='devstack@QuobyteHD#QuobyteHD',id=7864ba36-b70a-497a-a4af-34165e305150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:00Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c448d4b9-f84e-4487-be34-d543499427f9),volume_type_id=c448d4b9-f84e-4487-be34-d543499427f9)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Creating volume 7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:04:59 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:04:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:04:59 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 1073741824
Jun 17 04:04:59 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:00 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 1073741824" returned: 0 in 0.800s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:00 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150
Jun 17 04:05:00 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:01 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150" returned: 0 in 0.620s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85c237-1f77-4cbd-99ca-c83cf33bd2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7864ba36-b70a-497a-a4af-34165e305150', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe1bac2-0f76-4794-96db-a806ea3ae7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:01 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Volume volume-7864ba36-b70a-497a-a4af-34165e305150 (7864ba36-b70a-497a-a4af-34165e305150): created successfully
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe1bac2-0f76-4794-96db-a806ea3ae7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (926e1ebd-3098-4f6f-a3bc-6c69fce1f37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:05:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e8875905-3223-4308-95a0-e3c83bf85737 tempest-GroupSnapshotsTest-1186892099 None] Created volume successfully.
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:02 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:05:02 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-417ef8dd-9b17-4c0e-8c8e-537512b0e74c tempest-GroupSnapshotsTest-1186892099 None] Update group completed successfully.
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cc6749-1033-4bf4-a746-26c010326bea]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:02 devstack sudo[95185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01
Jun 17 04:05:02 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:02 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.601s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:05:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:05:03 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01" returned: 0 in 0.736s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.755s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-e7793824-e605-4e40-9ca8-f570cbe89e01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e196f03-10bf-4171-963f-b9a30af9ef1a', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:05:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-b636afec-88bd-43f2-aebb-d74692a6ff02 req-45fa645a-e2d4-46c5-b102-3e1a8038f27b tempest-TaggedAttachmentsTest-1983686342 None] attachment_update completed successfully.
Jun 17 04:05:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-61bc9d66-e637-45e2-81f4-b5c24aaa11a0 tempest-GroupSnapshotsTest-1186892099 None] Update group completed successfully.
Jun 17 04:05:04 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-658a4114-05c7-403a-aabb-1c1e6bc1382a tempest-GroupSnapshotsTest-1186892099 None] Update group completed successfully.
Jun 17 04:05:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ca72adba-d265-4339-94fc-5f09bddb2611 tempest-GroupSnapshotsTest-1186892099 None] Update group completed successfully.
Jun 17 04:05:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] GroupSnapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: creating.
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Group snapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: creating. {{(pid=92204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Creating offline snapshot 51c8fdc8-b442-4575-a172-33880b1482cc of volume a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07f9388-a174-44c8-9cf5-2451f95a966f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:07 devstack sudo[95581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17
Jun 17 04:05:07 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:08 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17" returned: 0 in 1.149s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:08 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc 1G
Jun 17 04:05:08 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:10 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc 1G" returned: 0 in 1.124s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:10 devstack sudo[95610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc
Jun 17 04:05:10 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:10 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc" returned: 0 in 0.755s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:10 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:10 devstack sudo[95616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc
Jun 17 04:05:10 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=71,cinder:INSERT=15,cinder:UPDATE=76,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=84,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=14 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:05:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-f049112d-84e9-4265-9637-fabd0f4c48fc req-c20704ed-9826-44c7-8a7b-9732358e18d1 tempest-TaggedAttachmentsTest-1983686342 None] Terminate volume connection completed successfully.
Jun 17 04:05:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f049112d-84e9-4265-9637-fabd0f4c48fc req-c20704ed-9826-44c7-8a7b-9732358e18d1 tempest-TaggedAttachmentsTest-1983686342 None] Deleting attachment 7e196f03-10bf-4171-963f-b9a30af9ef1a. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:05:11 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc" returned: 0 in 0.650s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:11 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info
Jun 17 04:05:11 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:12 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info" returned: 0 in 0.751s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:12 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:12 devstack sudo[95648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info
Jun 17 04:05:12 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:12 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.info" returned: 0 in 0.582s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.139s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Creating offline snapshot 94c8eff9-b725-49df-bd99-d418fce287bf of volume 7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047d4fc-92ef-4708-8437-5f78b49796c1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:13 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150
Jun 17 04:05:13 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:13 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150" returned: 0 in 0.769s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:13 devstack sudo[95668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf 1G
Jun 17 04:05:13 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:15 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf 1G" returned: 0 in 1.535s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7864ba36-b70a-497a-a4af-34165e305150 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:15 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7864ba36-b70a-497a-a4af-34165e305150 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf
Jun 17 04:05:15 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:16 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7864ba36-b70a-497a-a4af-34165e305150 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf" returned: 0 in 1.168s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:16 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:16 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf
Jun 17 04:05:16 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:17 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf" returned: 0 in 0.708s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:17 devstack sudo[95786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info
Jun 17 04:05:17 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:17 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info" returned: 0 in 0.649s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:17 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:17 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info
Jun 17 04:05:17 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:18 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.info" returned: 0 in 0.813s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.792s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:18 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d404d96d-b287-4048-a93e-f381b239e341 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: created successfully
Jun 17 04:05:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: deleting
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: deleting {{(pid=92204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" acquired by "delete_snapshot" :: waited 0.043s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-51c8fdc8-b442-4575-a172-33880b1482cc" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-51c8fdc8-b442-4575-a172-33880b1482cc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Deleting offline snapshot 51c8fdc8-b442-4575-a172-33880b1482cc of volume a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] snapshot_file for this snap is: volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b994d-caf3-4648-aff2-1e6b95f9f714]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:20 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc
Jun 17 04:05:20 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:20 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc" returned: 0 in 0.932s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:05:20 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f78322-81fa-4f24-859b-3338305c56ab]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:21 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17
Jun 17 04:05:21 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:22 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17" returned: 0 in 1.231s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:22 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc
Jun 17 04:05:22 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:22 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc" returned: 0 in 0.719s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:22 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc
Jun 17 04:05:22 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:23 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17.51c8fdc8-b442-4575-a172-33880b1482cc" returned: 0 in 0.998s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-51c8fdc8-b442-4575-a172-33880b1482cc" released by "_delete_snapshot" :: held 4.080s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" released by "delete_snapshot" :: held 4.125s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-94c8eff9-b725-49df-bd99-d418fce287bf" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-94c8eff9-b725-49df-bd99-d418fce287bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Deleting offline snapshot 94c8eff9-b725-49df-bd99-d418fce287bf of volume 7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:05:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] snapshot_file for this snap is: volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:05:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eec194-0bc8-49d6-9568-de514e79f071]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:24 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf
Jun 17 04:05:24 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:24 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf" returned: 0 in 0.972s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7864ba36-b70a-497a-a4af-34165e305150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:05:25 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f846a231-86fb-4665-800e-15c74fd473b1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:25 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150
Jun 17 04:05:25 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:25 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150" returned: 0 in 0.799s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:25 devstack sudo[95895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf
Jun 17 04:05:25 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:26 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf" returned: 0 in 0.773s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:26 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf
Jun 17 04:05:26 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:27 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150.94c8eff9-b725-49df-bd99-d418fce287bf" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-94c8eff9-b725-49df-bd99-d418fce287bf" released by "_delete_snapshot" :: held 3.365s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" released by "delete_snapshot" :: held 3.396s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:27 devstack cinder-volume[92204]: WARNING cinder.quota [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2076677372 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2076677372, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:27 devstack cinder-volume[92204]: WARNING cinder.quota [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2076677372 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2076677372, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['938b3897-2490-4bca-a9c7-211dcc1db8e1', '80e71398-7b56-4694-b593-39304772ce9c', 'a3eb7064-afba-41de-93ac-6edc9c5db4bd', '308819af-af4f-44ef-ab27-323cef5460f1'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['6ec42e37-d136-4864-b2cb-3307d7808050', 'b40ab03f-55c2-44f5-91e1-dc47201ba2d0', 'e263ca52-d7e7-4215-a2e4-c33cdaa28694', '340946cb-1bd2-4d8a-8274-81a0284b3f07'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-09223796-8223-46e8-a79d-c75c262ad576 tempest-GroupSnapshotsTest-1186892099 None] group_snapshot 7ca59c25-b5b1-4837-8452-2115b526fa39: deleted successfully
Jun 17 04:05:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9c7ee-67dc-4ee6-9ad8-d9ec3916b1db]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:28 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150
Jun 17 04:05:28 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:29 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150" returned: 0 in 0.890s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:29 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150
Jun 17 04:05:29 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "cinder-e7793824-e605-4e40-9ca8-f570cbe89e01-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "cinder-e7793824-e605-4e40-9ca8-f570cbe89e01-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "cinder-quobyte-e7793824-e605-4e40-9ca8-f570cbe89e01" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "cinder-quobyte-e7793824-e605-4e40-9ca8-f570cbe89e01" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a27b53-c810-4b52-b07f-2cca1e6b6188]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:30 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01
Jun 17 04:05:30 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be23d8-85db-45fb-ab5c-889c6fca3253]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:30 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7864ba36-b70a-497a-a4af-34165e305150" returned: 0 in 0.706s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-7864ba36-b70a-497a-a4af-34165e305150" released by "delete_volume" :: held 1.671s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:30 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a
Jun 17 04:05:30 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e39a86-cc9d-4b7f-b301-a449c80701f6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:30 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17
Jun 17 04:05:30 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:30 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01" returned: 0 in 0.731s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:30 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01
Jun 17 04:05:30 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:31 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a" returned: 0 in 0.753s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-96bb688c-1a01-4754-b160-ef483c36bd2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49df8a59-432a-4717-88df-21ee349621f5', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:05:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-4688ad23-6444-4f9c-9f4f-209f66289293 req-d5b5639d-97d9-4e16-8fed-1adef677a47a tempest-ServerActionsTestOtherA-1125359793 None] attachment_update completed successfully.
Jun 17 04:05:31 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17" returned: 0 in 0.744s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:31 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17
Jun 17 04:05:31 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:31 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e7793824-e605-4e40-9ca8-f570cbe89e01" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "cinder-quobyte-e7793824-e605-4e40-9ca8-f570cbe89e01" released by "delete_volume" :: held 1.409s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Created reservations ['59e7838e-4c08-4c17-ba10-8542261640df', '66af4d45-b8f5-4e8e-a7d4-d37347fb36ba', '3bb5dc63-8b9e-4c7f-870d-dc123fd1f34d', 'de0c3ab2-465f-4257-a1d1-36232ecf98a2'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:31 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:05:31 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:31 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a2a39a72-8eb5-44b7-ba74-62639eba1e17" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-a2a39a72-8eb5-44b7-ba74-62639eba1e17" released by "delete_volume" :: held 1.406s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['12845262-9276-4322-8a29-fc38efeca105'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:31 devstack cinder-volume[92204]: WARNING cinder.quota [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2076677372 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2076677372, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:31 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['55370fe9-2c72-4b25-8ef3-d5ca48e40281', '0af17321-ab19-41ea-8f80-b39c390dbf4a', '6a1aebc1-4676-4fd7-9693-e596c5323321', 'c8d92884-0065-4a70-9760-5c77750e92c5'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['7e7ad396-4363-46f5-9e28-9dcd01540e2a', '769a8757-6df4-4596-88d2-025f4f4af6a1', '6bed34c3-a63f-42fd-805d-df7e8621d9e1', 'c0818881-40dd-4201-9b94-47f79be79c50'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:32 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.674s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:05:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Deleted volume successfully.
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e480cfdb-ccfe-440b-8f51-64530e7c9174 tempest-TaggedAttachmentsTest-1983686342 None] Lock "cinder-e7793824-e605-4e40-9ca8-f570cbe89e01-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:32 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:05:32 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:32 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.597s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:32 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:05:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2ab6448a-0a8c-4e21-84e3-1fa1617e588b tempest-GroupSnapshotsTest-1186892099 None] Delete group completed successfully.
Jun 17 04:05:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ac0772a8-290f-4466-8c50-854edc8ae4d2 tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-644932494: creating
Jun 17 04:05:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ac0772a8-290f-4466-8c50-854edc8ae4d2 tempest-GroupSnapshotsTest-1186892099 None] Group tempest-GroupSnapshotsTest-Group-644932494: created successfully
Jun 17 04:05:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ac0772a8-290f-4466-8c50-854edc8ae4d2 tempest-GroupSnapshotsTest-1186892099 None] Create group completed successfully.
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (a8aa99ab-1d1c-4084-b07f-2f004f473359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc62600-a974-485a-ace5-e386a0deebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc62600-a974-485a-ace5-e386a0deebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857306191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ef4c57b-ef77-4b11-9aef-f268b0c3fe2a,host='devstack@QuobyteHD#QuobyteHD',id=3859f1fc-7395-4945-bee0-a6ce2afe7824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:35Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(433a952c-ec40-4a94-b8cd-cd2eac58d52b),volume_type_id=433a952c-ec40-4a94-b8cd-cd2eac58d52b)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba8cdd7-a3e5-4a09-b237-96f91618e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba8cdd7-a3e5-4a09-b237-96f91618e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831917d-1bb0-4e2a-b651-15f26606491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831917d-1bb0-4e2a-b651-15f26606491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3859f1fc-7395-4945-bee0-a6ce2afe7824', 'volume_name': 'volume-3859f1fc-7395-4945-bee0-a6ce2afe7824', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6e8da1-df62-4801-be3a-83f09ea535d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6e8da1-df62-4801-be3a-83f09ea535d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f53b7-7da2-4b7f-9102-0bc486b90f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Volume 3859f1fc-7395-4945-bee0-a6ce2afe7824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3859f1fc-7395-4945-bee0-a6ce2afe7824', 'volume_size': 1}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7ef4c57b-ef77-4b11-9aef-f268b0c3fe2a,created_at=2026-06-17T02:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857306191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ef4c57b-ef77-4b11-9aef-f268b0c3fe2a,host='devstack@QuobyteHD#QuobyteHD',id=3859f1fc-7395-4945-bee0-a6ce2afe7824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9153b123af624dd7b1f11ae910736c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:35Z,use_quota=True,user_id='2beb64a39c8d4e23a3f318ed9af57785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(433a952c-ec40-4a94-b8cd-cd2eac58d52b),volume_type_id=433a952c-ec40-4a94-b8cd-cd2eac58d52b)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Creating volume 3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:05:35 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:05:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:35 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 1073741824
Jun 17 04:05:35 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:36 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 1073741824" returned: 0 in 1.306s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:36 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824
Jun 17 04:05:36 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:37 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824" returned: 0 in 0.679s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f53b7-7da2-4b7f-9102-0bc486b90f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3859f1fc-7395-4945-bee0-a6ce2afe7824', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3b0bd-494f-4d91-ad44-dfb2920067fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Volume volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 (3859f1fc-7395-4945-bee0-a6ce2afe7824): created successfully
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3b0bd-494f-4d91-ad44-dfb2920067fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Flow 'volume_create_manager' (a8aa99ab-1d1c-4084-b07f-2f004f473359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:05:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3ace5639-db90-4ceb-9209-750fca1fbfa8 tempest-GroupSnapshotsTest-1186892099 None] Created volume successfully.
Jun 17 04:05:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] GroupSnapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: creating.
Jun 17 04:05:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Group snapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: creating. {{(pid=92204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Creating offline snapshot e40afe67-5cba-4488-857e-5223cf263317 of volume 3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a1c21-8181-4495-a1b0-18dc5d3d4fb0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:38 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824
Jun 17 04:05:38 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:38 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824" returned: 0 in 0.889s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:38 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 1G
Jun 17 04:05:38 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-d341bf39-35e0-4d81-8a75-71a71473ef8f tempest-ServerActionsTestOtherA-1125359793 None] Terminate volume connection completed successfully.
Jun 17 04:05:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-d341bf39-35e0-4d81-8a75-71a71473ef8f tempest-ServerActionsTestOtherA-1125359793 None] Deleting attachment 49df8a59-432a-4717-88df-21ee349621f5. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:05:39 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 1G" returned: 0 in 0.911s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:39 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317
Jun 17 04:05:39 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:40 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317" returned: 0 in 0.690s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:40 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:40 devstack sudo[96501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317
Jun 17 04:05:40 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:41 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317" returned: 0 in 0.661s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:41 devstack sudo[96504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info
Jun 17 04:05:41 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:41 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:41 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:05:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:42 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info
Jun 17 04:05:42 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Flow 'volume_create_manager' (993d55a3-0795-40a2-80bf-d38af23989b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfaa46a-3918-488e-8c2b-6c3d5b6e237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfaa46a-3918-488e-8c2b-6c3d5b6e237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-320665578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb14d0-6f30-4786-a56f-0724dab922cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259db7612a2243649826c4e6021c4a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:42Z,use_quota=True,user_id='cea9983228f441beb8ab397db7ea15b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c71fa6-2e1d-4415-98f2-bb2c835d9427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c71fa6-2e1d-4415-98f2-bb2c835d9427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23423349-c612-479b-aed3-128609332703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23423349-c612-479b-aed3-128609332703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86eb14d0-6f30-4786-a56f-0724dab922cf', 'volume_name': 'volume-86eb14d0-6f30-4786-a56f-0724dab922cf', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5251e859-03af-48c5-9ea2-d9d0fc515e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5251e859-03af-48c5-9ea2-d9d0fc515e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2b9cf-dd0e-473e-8f3c-f1e9bb82579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:42 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Volume 86eb14d0-6f30-4786-a56f-0724dab922cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86eb14d0-6f30-4786-a56f-0724dab922cf', 'volume_size': 1}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:42 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.info" returned: 0 in 0.731s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.686s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.127s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf8cc78-3d1a-4d1a-b2e7-979320b7de6f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6e9a74dd-54ba-4ea7-ba02-33a0d85e43ca tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: created successfully
Jun 17 04:05:42 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a
Jun 17 04:05:42 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:43 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a" returned: 0 in 0.799s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-320665578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb14d0-6f30-4786-a56f-0724dab922cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259db7612a2243649826c4e6021c4a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:05:42Z,use_quota=True,user_id='cea9983228f441beb8ab397db7ea15b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Creating volume 86eb14d0-6f30-4786-a56f-0724dab922cf {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:05:43 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:43 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf 1073741824
Jun 17 04:05:43 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: deleting
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: deleting {{(pid=92204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-96bb688c-1a01-4754-b160-ef483c36bd2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54369b33-849f-4c14-802e-14d58540e294', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-e40afe67-5cba-4488-857e-5223cf263317" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-e40afe67-5cba-4488-857e-5223cf263317" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Deleting offline snapshot e40afe67-5cba-4488-857e-5223cf263317 of volume 3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] snapshot_file for this snap is: volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:05:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-74873bb1-9dec-4b50-85d6-c436d3627126 req-af0b01f6-3ff2-47b6-b9db-0435684b264e tempest-ServerActionsTestOtherA-1125359793 None] attachment_update completed successfully.
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4880e-397e-4716-a331-5a6147bef5a7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:43 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317
Jun 17 04:05:43 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:44 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf 1073741824" returned: 0 in 0.882s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:44 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3859f1fc-7395-4945-bee0-a6ce2afe7824(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:05:44 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf
Jun 17 04:05:44 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1259f-4eb0-425e-be10-156dcbcbe848]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:44 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824
Jun 17 04:05:44 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:45 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf" returned: 0 in 0.650s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2b9cf-dd0e-473e-8f3c-f1e9bb82579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eb14d0-6f30-4786-a56f-0724dab922cf', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c778c7-f631-4650-b094-03f7ac7bf28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:05:45 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Volume volume-86eb14d0-6f30-4786-a56f-0724dab922cf (86eb14d0-6f30-4786-a56f-0724dab922cf): created successfully
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c778c7-f631-4650-b094-03f7ac7bf28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Flow 'volume_create_manager' (993d55a3-0795-40a2-80bf-d38af23989b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:05:45 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b9f0a851-2ff5-4553-8456-b8d526dfb6c6 tempest-AttachVolumeShelveTestJSON-185434045 None] Created volume successfully.
Jun 17 04:05:45 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824" returned: 0 in 0.869s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:45 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317
Jun 17 04:05:45 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:46 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317" returned: 0 in 0.819s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:46 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317
Jun 17 04:05:46 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:46 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824.e40afe67-5cba-4488-857e-5223cf263317" returned: 0 in 0.771s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-e40afe67-5cba-4488-857e-5223cf263317" released by "_delete_snapshot" :: held 3.307s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" released by "delete_snapshot" :: held 3.337s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:47 devstack cinder-volume[92204]: WARNING cinder.quota [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1663029760 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1663029760, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:47 devstack cinder-volume[92204]: WARNING cinder.quota [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1663029760 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1663029760, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:47 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['7a3f5739-a88f-453c-9605-093c44f5c3db', '4015c476-f196-4179-9dda-33c001af24f4', '1a1f8fd3-3930-4cdf-8cf7-a06626f555ed', 'a243e4cc-ce3e-46ae-a606-dc6127421af1'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1ae7711e-38bc-4c24-bec5-e3792132565d tempest-GroupSnapshotsTest-1186892099 None] group_snapshot ba7437d9-35a3-4dcb-8133-af5eac4839c3: deleted successfully
Jun 17 04:05:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:05:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:05:48 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b08ca1-5c06-44e9-b989-e58b036cd6ce]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:05:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:48 devstack sudo[96647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824
Jun 17 04:05:48 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:49 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824" returned: 0 in 0.921s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:49 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824
Jun 17 04:05:49 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:50 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3859f1fc-7395-4945-bee0-a6ce2afe7824" returned: 0 in 0.811s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Lock "cinder-quobyte-3859f1fc-7395-4945-bee0-a6ce2afe7824" released by "delete_volume" :: held 1.828s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['030dbb2e-4647-4743-b03f-8fbe35c72f1d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:50 devstack cinder-volume[92204]: WARNING cinder.quota [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1663029760 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1663029760, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Created reservations ['d3316e71-34bc-4e20-8a6c-721de48e7b16', '2caf2970-e731-429b-aaf1-e4f6aeb99f7e', '14c43128-8b27-4910-b656-bc52dfdbe322', '5b0dea52-ae70-4ce0-b5dc-b40d57e8ed56'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:05:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:05:50 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:05:50 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:05:51 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Jun 17 04:05:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.991s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:05:51 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:05:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-80028198-1fd0-4083-bf7d-9dfa0e058f31 tempest-GroupSnapshotsTest-1186892099 None] Delete group completed successfully.
Jun 17 04:06:00 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=76,cinder:INSERT=17,cinder:SELECT=84 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:06:00 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=70,cinder:INSERT=18,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:02 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:02 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:03 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.884s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:06:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:06:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:06:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bac8c280-df8e-4323-b726-a7dcf9ec44f5 tempest-GroupsTest-1638254924 None] Group tempest-Group1-1989170329: creating
Jun 17 04:06:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bac8c280-df8e-4323-b726-a7dcf9ec44f5 tempest-GroupsTest-1638254924 None] Group tempest-Group1-1989170329: created successfully
Jun 17 04:06:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bac8c280-df8e-4323-b726-a7dcf9ec44f5 tempest-GroupsTest-1638254924 None] Create group completed successfully.
Jun 17 04:06:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8386711f-e867-4676-9e4e-3d4b7547b2ed tempest-GroupsTest-1638254924 None] Group tempest-Group2-1137648278: creating
Jun 17 04:06:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8386711f-e867-4676-9e4e-3d4b7547b2ed tempest-GroupsTest-1638254924 None] Group tempest-Group2-1137648278: created successfully
Jun 17 04:06:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8386711f-e867-4676-9e4e-3d4b7547b2ed tempest-GroupsTest-1638254924 None] Create group completed successfully.
Jun 17 04:06:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95bf9b0-4595-47e9-af92-681131c7d69f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:08 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf
Jun 17 04:06:08 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:09 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf" returned: 0 in 0.696s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.713s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-86eb14d0-6f30-4786-a56f-0724dab922cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed281503-fe89-4cc1-a0bc-f49b6c7594de', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:06:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-85969f29-b6a0-4e7e-8ef1-427843214e6d req-bc3378dd-52d9-4594-8774-2ecb60c14e1a tempest-AttachVolumeShelveTestJSON-185434045 None] attachment_update completed successfully.
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (1762f321-d246-4394-ac9e-268c32dcb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14db1fd-5beb-485a-bfe4-c3beba624f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14db1fd-5beb-485a-bfe4-c3beba624f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596895722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ef2c4b5-323f-4ab6-ade1-dca185dc3299,host='devstack@QuobyteHD#QuobyteHD',id=2b440c67-eed8-46fc-8335-809369f15ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:10Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87058749-f324-4f5a-b606-96fd0d092ddf),volume_type_id=87058749-f324-4f5a-b606-96fd0d092ddf)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e533e-7168-4c16-a267-f3e5e73827ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e533e-7168-4c16-a267-f3e5e73827ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a7cee6-436e-46ed-825a-8e013b8f9aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a7cee6-436e-46ed-825a-8e013b8f9aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b440c67-eed8-46fc-8335-809369f15ff9', 'volume_name': 'volume-2b440c67-eed8-46fc-8335-809369f15ff9', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41db8f8-a274-4df0-9b31-c26c3f61e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41db8f8-a274-4df0-9b31-c26c3f61e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f4b7f8-b47b-4f09-9566-5ddce507e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:10 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Volume 2b440c67-eed8-46fc-8335-809369f15ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b440c67-eed8-46fc-8335-809369f15ff9', 'volume_size': 1}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8ef2c4b5-323f-4ab6-ade1-dca185dc3299,created_at=2026-06-17T02:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596895722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ef2c4b5-323f-4ab6-ade1-dca185dc3299,host='devstack@QuobyteHD#QuobyteHD',id=2b440c67-eed8-46fc-8335-809369f15ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:10Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87058749-f324-4f5a-b606-96fd0d092ddf),volume_type_id=87058749-f324-4f5a-b606-96fd0d092ddf)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Creating volume 2b440c67-eed8-46fc-8335-809369f15ff9 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:06:10 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:06:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:10 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 1073741824
Jun 17 04:06:10 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:11 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 1073741824" returned: 0 in 1.099s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:11 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9
Jun 17 04:06:11 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:12 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9" returned: 0 in 0.731s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f4b7f8-b47b-4f09-9566-5ddce507e7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b440c67-eed8-46fc-8335-809369f15ff9', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c38536-56a9-4f5a-a286-e94a0915d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:12 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Volume volume-2b440c67-eed8-46fc-8335-809369f15ff9 (2b440c67-eed8-46fc-8335-809369f15ff9): created successfully
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c38536-56a9-4f5a-a286-e94a0915d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (1762f321-d246-4394-ac9e-268c32dcb783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1225df09-3c32-4354-95b8-7d85a8a58b90 tempest-GroupsTest-1638254924 None] Created volume successfully.
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Acquiring lock "cinder-quobyte-2b440c67-eed8-46fc-8335-809369f15ff9" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-2b440c67-eed8-46fc-8335-809369f15ff9" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b1c35-3d8d-483f-bbe4-2f0c52bace0b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:12 devstack sudo[97175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9
Jun 17 04:06:12 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:13 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:13 devstack sudo[97181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9
Jun 17 04:06:13 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:14 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2b440c67-eed8-46fc-8335-809369f15ff9" returned: 0 in 0.640s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-2b440c67-eed8-46fc-8335-809369f15ff9" released by "delete_volume" :: held 1.399s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Created reservations ['2eb3d18f-e127-41f3-a52d-7f5152f06d98'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:14 devstack cinder-volume[92204]: WARNING cinder.quota [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-87210592 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-87210592, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:06:14 devstack cinder-volume[92204]: WARNING cinder.quota [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-87210592 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-87210592, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Created reservations ['d4245516-3faa-43b2-b453-3ceb9917e1f6', '08b54f35-4191-4d7f-b0fc-c360c58712d9', '70d6006b-06c1-4bf5-8742-0d1e20a8e548', 'f96deb21-d202-47c8-b3bc-eb83d84fd343'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:14 devstack sudo[97185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:14 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:15 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:15 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c4e93e4d-0588-4304-9224-ea4cec02f1ea tempest-GroupsTest-1638254924 None] Delete group completed successfully.
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Created reservations ['0fef2936-c218-4485-b37e-ae9d8bd0e141'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:15 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:15 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:15 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:15 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:15 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8c6ae1fd-cf93-4f8b-bd97-e9fb30dbc82e tempest-GroupsTest-1638254924 None] Delete group completed successfully.
Jun 17 04:06:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0d64fcb0-0d6d-41e5-9c73-018ae5139516 tempest-GroupsTest-1638254924 None] Group tempest-GroupsTest-Group-957145102: creating
Jun 17 04:06:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0d64fcb0-0d6d-41e5-9c73-018ae5139516 tempest-GroupsTest-1638254924 None] Group tempest-GroupsTest-Group-957145102: created successfully
Jun 17 04:06:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0d64fcb0-0d6d-41e5-9c73-018ae5139516 tempest-GroupsTest-1638254924 None] Create group completed successfully.
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (cdc626a5-4b4c-4bf3-b080-82804b37e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2318e7-ff9e-4ca9-9c0d-3c0995a8ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2318e7-ff9e-4ca9-9c0d-3c0995a8ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892144231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da870c16-807e-469a-8d00-a4f9aff78325,host='devstack@QuobyteHD#QuobyteHD',id=43551fb9-15d2-44b0-bfc7-3242eba53844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:19Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5),volume_type_id=ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cec8a7-5482-4691-87a2-292c95c9c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cec8a7-5482-4691-87a2-292c95c9c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71e0574-c9ef-455e-9b5f-8ac63058ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71e0574-c9ef-455e-9b5f-8ac63058ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43551fb9-15d2-44b0-bfc7-3242eba53844', 'volume_name': 'volume-43551fb9-15d2-44b0-bfc7-3242eba53844', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751ebf21-1b96-4fda-b418-03846192ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751ebf21-1b96-4fda-b418-03846192ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51574f4-054b-484b-9ac6-a06288392bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Volume 43551fb9-15d2-44b0-bfc7-3242eba53844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43551fb9-15d2-44b0-bfc7-3242eba53844', 'volume_size': 1}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da870c16-807e-469a-8d00-a4f9aff78325,created_at=2026-06-17T02:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892144231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da870c16-807e-469a-8d00-a4f9aff78325,host='devstack@QuobyteHD#QuobyteHD',id=43551fb9-15d2-44b0-bfc7-3242eba53844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:19Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5),volume_type_id=ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Creating volume 43551fb9-15d2-44b0-bfc7-3242eba53844 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:06:19 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:06:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:19 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 1073741824
Jun 17 04:06:19 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:20 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 1073741824" returned: 0 in 1.273s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:20 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844
Jun 17 04:06:20 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:21 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844" returned: 0 in 0.896s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51574f4-054b-484b-9ac6-a06288392bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43551fb9-15d2-44b0-bfc7-3242eba53844', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ad1e01-659e-4f0b-a65e-bb3b8d4928b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Volume volume-43551fb9-15d2-44b0-bfc7-3242eba53844 (43551fb9-15d2-44b0-bfc7-3242eba53844): created successfully
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ad1e01-659e-4f0b-a65e-bb3b8d4928b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (cdc626a5-4b4c-4bf3-b080-82804b37e834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:21 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a1887ffa-fd41-4717-88d7-7f416af9da49 tempest-GroupsTest-1638254924 None] Created volume successfully.
Jun 17 04:06:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-ec4d7df6-7350-4918-bb41-0bdb3e18f50d req-1f5a5452-887b-4cda-a7ac-315adad4bbb5 tempest-ServerActionsTestOtherA-1125359793 None] Terminate volume connection completed successfully.
Jun 17 04:06:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-ec4d7df6-7350-4918-bb41-0bdb3e18f50d req-1f5a5452-887b-4cda-a7ac-315adad4bbb5 tempest-ServerActionsTestOtherA-1125359793 None] Deleting attachment 54369b33-849f-4c14-802e-14d58540e294. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (dfabc014-de4a-4c44-a5e0-ef5cb920410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c528a175-051a-4994-a03a-9faa7b3bb72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c528a175-051a-4994-a03a-9faa7b3bb72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1695945503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da870c16-807e-469a-8d00-a4f9aff78325,host='devstack@QuobyteHD#QuobyteHD',id=09326bf7-701d-4401-91bd-e0af6351b646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:23Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5),volume_type_id=ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79852fe-95fe-4f3c-8b3c-2161b4e75e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79852fe-95fe-4f3c-8b3c-2161b4e75e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c46c618-6d96-4ad7-a701-30d548e5c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c46c618-6d96-4ad7-a701-30d548e5c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09326bf7-701d-4401-91bd-e0af6351b646', 'volume_name': 'volume-09326bf7-701d-4401-91bd-e0af6351b646', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d27734-38f4-4dbc-9f03-fde8336d00ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d27734-38f4-4dbc-9f03-fde8336d00ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeae63c-5757-4b6a-a644-4c6bb71d69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Volume 09326bf7-701d-4401-91bd-e0af6351b646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09326bf7-701d-4401-91bd-e0af6351b646', 'volume_size': 1}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da870c16-807e-469a-8d00-a4f9aff78325,created_at=2026-06-17T02:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1695945503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da870c16-807e-469a-8d00-a4f9aff78325,host='devstack@QuobyteHD#QuobyteHD',id=09326bf7-701d-4401-91bd-e0af6351b646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca5c61d7cf4512a6136542336b3066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:23Z,use_quota=True,user_id='e16635a792b14af0ba72b4041b341b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5),volume_type_id=ad9e7ba0-b3f2-4156-9f18-b3b012dbf3a5)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Creating volume 09326bf7-701d-4401-91bd-e0af6351b646 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:06:23 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:06:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:23 devstack sudo[97325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 1073741824
Jun 17 04:06:23 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:24 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 1073741824" returned: 0 in 1.140s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:24 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646
Jun 17 04:06:24 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:25 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646" returned: 0 in 0.665s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeae63c-5757-4b6a-a644-4c6bb71d69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09326bf7-701d-4401-91bd-e0af6351b646', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec99479-6b71-4733-b1f4-8d0addde6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Volume volume-09326bf7-701d-4401-91bd-e0af6351b646 (09326bf7-701d-4401-91bd-e0af6351b646): created successfully
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec99479-6b71-4733-b1f4-8d0addde6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Flow 'volume_create_manager' (dfabc014-de4a-4c44-a5e0-ef5cb920410c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2be0d27d-2258-47e7-b007-6f1409e29ed2 tempest-GroupsTest-1638254924 None] Created volume successfully.
Jun 17 04:06:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7ad42e8c-2043-4459-9a55-78b84185dece tempest-GroupsTest-1638254924 None] Update group completed successfully.
Jun 17 04:06:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bf4225f2-fbf2-4a4d-b4a7-49d0c7c6e134 tempest-GroupsTest-1638254924 None] Update group completed successfully.
Jun 17 04:06:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Acquiring lock "cinder-quobyte-09326bf7-701d-4401-91bd-e0af6351b646" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:06:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-09326bf7-701d-4401-91bd-e0af6351b646" acquired by "delete_volume" :: waited 0.061s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:06:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6ff4c7-c138-4c1b-9ea4-9251cbd6d14e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:29 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646
Jun 17 04:06:29 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:30 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646" returned: 0 in 0.929s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:30 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646
Jun 17 04:06:30 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:30 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-09326bf7-701d-4401-91bd-e0af6351b646" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-09326bf7-701d-4401-91bd-e0af6351b646" released by "delete_volume" :: held 1.704s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Acquiring lock "cinder-quobyte-43551fb9-15d2-44b0-bfc7-3242eba53844" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-43551fb9-15d2-44b0-bfc7-3242eba53844" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b45de4a-4c9c-49da-bc29-0710cd04c65e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:31 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844
Jun 17 04:06:31 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:32 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844" returned: 0 in 1.132s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:32 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844
Jun 17 04:06:32 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:32 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43551fb9-15d2-44b0-bfc7-3242eba53844" returned: 0 in 0.779s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "cinder-quobyte-43551fb9-15d2-44b0-bfc7-3242eba53844" released by "delete_volume" :: held 1.973s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:06:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Created reservations ['f67c9de0-e7e7-495e-8250-09955850cb85'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:32 devstack cinder-volume[92204]: WARNING cinder.quota [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-725366316 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-725366316, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:06:32 devstack cinder-volume[92204]: WARNING cinder.quota [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-725366316 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-725366316, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Created reservations ['5e5141df-0d38-4cb8-839f-a079a1732ad0', 'e69559d3-e0d8-4bed-b6d0-6ae4e1027f8b', '46c6ec8d-64b9-40ba-bfdd-298b250f87a8', '75ad1b09-c6d7-4ea2-b7b7-28c1b591a014'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Created reservations ['4183f490-b9af-4dad-9e84-cad186b5924e', '0e3892d0-88b4-4742-b702-24fbe9c42afb', '1a2f0ab8-c415-4efa-96ef-d903bd5154cc', '2e0a2137-0f9d-417f-a8d3-25f836a3c598'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:33 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:33 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "cinder-96bb688c-1a01-4754-b160-ef483c36bd2a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "cinder-96bb688c-1a01-4754-b160-ef483c36bd2a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "cinder-quobyte-96bb688c-1a01-4754-b160-ef483c36bd2a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "cinder-quobyte-96bb688c-1a01-4754-b160-ef483c36bd2a" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e477cc-1a4d-496e-8e12-41390af0090d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:33 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a
Jun 17 04:06:33 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:33 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.730s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:34 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b8f7543d-d3d3-4fba-9304-02fe7c554206 tempest-GroupsTest-1638254924 None] Delete group completed successfully.
Jun 17 04:06:34 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a" returned: 0 in 0.792s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:34 devstack sudo[97887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a
Jun 17 04:06:34 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:35 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-96bb688c-1a01-4754-b160-ef483c36bd2a" returned: 0 in 0.691s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "cinder-quobyte-96bb688c-1a01-4754-b160-ef483c36bd2a" released by "delete_volume" :: held 1.551s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Created reservations ['1e8b751b-34f7-4d1e-8c18-6a05bb3da572', '0e405e8c-4fce-45f6-8e31-18a9cab242fd', '265c798a-3f83-4f77-9f9f-361e83ddf50b', '5a438b3c-8539-4774-b630-b1a9f83ed552'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:35 devstack sudo[97891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:35 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:36 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.848s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:36 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:36 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Deleted volume successfully.
Jun 17 04:06:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d74053a-f120-4fb1-8ba3-873eac652424 tempest-ServerActionsTestOtherA-1125359793 None] Lock "cinder-96bb688c-1a01-4754-b160-ef483c36bd2a-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (e2d88fb0-8ae5-42ec-ab69-938f303f0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9330f2-6d1d-48c3-9ce0-6ea18bf061ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9330f2-6d1d-48c3-9ce0-6ea18bf061ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2144807107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38943150-1a40-49b0-a2ca-a5a28d6ca12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:44Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49c1f8c-d940-4b75-b403-b4ba6affc076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49c1f8c-d940-4b75-b403-b4ba6affc076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f274e8c-375f-45eb-b4f8-b8fd13923f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f274e8c-375f-45eb-b4f8-b8fd13923f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38943150-1a40-49b0-a2ca-a5a28d6ca12d', 'volume_name': 'volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74c2699-6f9b-488d-92a3-85f41ea3075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74c2699-6f9b-488d-92a3-85f41ea3075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cc7835-956e-48f8-894b-b7b48bdd283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:44 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Volume 38943150-1a40-49b0-a2ca-a5a28d6ca12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d', 'volume_size': 1}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2144807107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38943150-1a40-49b0-a2ca-a5a28d6ca12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:44Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Creating volume 38943150-1a40-49b0-a2ca-a5a28d6ca12d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:06:44 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:06:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:44 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d 1073741824
Jun 17 04:06:44 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:45 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d 1073741824" returned: 0 in 0.919s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:45 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d
Jun 17 04:06:45 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:45 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cc7835-956e-48f8-894b-b7b48bdd283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048f9ff-b885-4178-b105-ddde4cb2d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:46 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Volume volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d (38943150-1a40-49b0-a2ca-a5a28d6ca12d): created successfully
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048f9ff-b885-4178-b105-ddde4cb2d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (e2d88fb0-8ae5-42ec-ab69-938f303f0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8cc1a782-925c-4b1e-b4f6-a28aebb0df33 tempest-AttachVolumeTestJSON-664675265 None] Created volume successfully.
Jun 17 04:06:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b764a31d-0716-4a9c-af56-02c70c53b7e0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:06:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:49 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d
Jun 17 04:06:49 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:50 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d" returned: 0 in 0.876s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddb46dc5-6d55-4794-b99b-cdc273476b66', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:06:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-c3923817-1f6e-4b7d-a4a0-bb8f85f774db req-33a4ff3b-36a6-4343-98c0-0ec7053af457 tempest-AttachVolumeTestJSON-664675265 None] attachment_update completed successfully.
Jun 17 04:06:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-43480742-3078-41df-86e5-9f7940b3ad76 tempest-GroupsV320Test-1195402778 None] Group tempest-GroupsV320Test-Group-460911693: creating
Jun 17 04:06:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-43480742-3078-41df-86e5-9f7940b3ad76 tempest-GroupsV320Test-1195402778 None] Group tempest-GroupsV320Test-Group-460911693: created successfully
Jun 17 04:06:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-43480742-3078-41df-86e5-9f7940b3ad76 tempest-GroupsV320Test-1195402778 None] Create group completed successfully.
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Created reservations ['b2bef6fb-c1bc-4616-a608-f20f0c595e98'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:54 devstack sudo[98038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:06:54 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-b67c3b43-4231-4540-abb1-a302a725ae6a req-60b31a63-73aa-4416-b3b3-24b863d2ed7d tempest-AttachVolumeShelveTestJSON-185434045 None] Terminate volume connection completed successfully.
Jun 17 04:06:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-b67c3b43-4231-4540-abb1-a302a725ae6a req-60b31a63-73aa-4416-b3b3-24b863d2ed7d tempest-AttachVolumeShelveTestJSON-185434045 None] Deleting attachment ed281503-fe89-4cc1-a0bc-f49b6c7594de. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:06:55 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.674s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:55 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:06:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-99617123-cd80-403b-83fd-b8288124853a tempest-GroupsV320Test-1195402778 None] Delete group completed successfully.
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Flow 'volume_create_manager' (0858964a-85da-48e9-b431-8e4db1014ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a90b834-3a9d-47ca-8bac-b0d660f13141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a90b834-3a9d-47ca-8bac-b0d660f13141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-726711117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b8c04-82e8-489a-96ce-4bd221cec84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683983fda9f4db295a4de7ea116ee0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:57Z,use_quota=True,user_id='072cd6b5aa3d4d8586021fc3eb83dc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d355dec-fcb9-4484-96f2-3ea45d63238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d355dec-fcb9-4484-96f2-3ea45d63238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92fae0-fa7a-49a1-8db5-695951c49a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92fae0-fa7a-49a1-8db5-695951c49a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585b8c04-82e8-489a-96ce-4bd221cec84c', 'volume_name': 'volume-585b8c04-82e8-489a-96ce-4bd221cec84c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdeeef8e-c438-40c6-8134-464930e9bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdeeef8e-c438-40c6-8134-464930e9bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d121ba3-9d26-4cb3-943a-411d008e427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Volume 585b8c04-82e8-489a-96ce-4bd221cec84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585b8c04-82e8-489a-96ce-4bd221cec84c', 'volume_size': 1}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-726711117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b8c04-82e8-489a-96ce-4bd221cec84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683983fda9f4db295a4de7ea116ee0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:06:57Z,use_quota=True,user_id='072cd6b5aa3d4d8586021fc3eb83dc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Creating volume 585b8c04-82e8-489a-96ce-4bd221cec84c {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:06:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:06:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:57 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c 1073741824
Jun 17 04:06:57 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:58 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c 1073741824" returned: 0 in 1.266s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:06:58 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c
Jun 17 04:06:58 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:06:59 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c" returned: 0 in 0.679s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d121ba3-9d26-4cb3-943a-411d008e427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585b8c04-82e8-489a-96ce-4bd221cec84c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623fe84-fff7-4476-ba3c-0b302e6f2787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:06:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Volume volume-585b8c04-82e8-489a-96ce-4bd221cec84c (585b8c04-82e8-489a-96ce-4bd221cec84c): created successfully
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623fe84-fff7-4476-ba3c-0b302e6f2787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:06:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Flow 'volume_create_manager' (0858964a-85da-48e9-b431-8e4db1014ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:06:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0fe81c86-a29a-4d7f-8e63-2b7610af4061 tempest-VolumesServicesTestJSON-610758552 None] Created volume successfully.
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Acquiring lock "cinder-585b8c04-82e8-489a-96ce-4bd221cec84c-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "cinder-585b8c04-82e8-489a-96ce-4bd221cec84c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=68,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=14 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=76,cinder:UPDATE=66,cinder:INSERT=11,cinder:DELETE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Acquiring lock "cinder-quobyte-585b8c04-82e8-489a-96ce-4bd221cec84c" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "cinder-quobyte-585b8c04-82e8-489a-96ce-4bd221cec84c" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[103adbeb-ba70-4022-b8dc-78cec9ab338b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:00 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c
Jun 17 04:07:00 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:01 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:01 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c
Jun 17 04:07:01 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:02 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-585b8c04-82e8-489a-96ce-4bd221cec84c" returned: 0 in 0.612s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:02 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:02 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "cinder-quobyte-585b8c04-82e8-489a-96ce-4bd221cec84c" released by "delete_volume" :: held 1.455s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Created reservations ['c389cc87-c847-4812-9872-85e862703fad', 'b2c49252-91f9-4594-87e4-b63e57defe4f', '03ac1f2f-74ae-4f3b-8d36-5ef93465aa98', 'bb5a1c49-c4a2-47e8-883c-53a1bf2734b0'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:02 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:02 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Flow 'volume_create_manager' (c85169d0-9126-4cab-9364-f0ccf0d2d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ed53d7-f420-4556-87cb-9c1c324c06f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ed53d7-f420-4556-87cb-9c1c324c06f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1329719179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8ba98ac0ea4ee9a29f2934ecad39f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:02Z,use_quota=True,user_id='e861c95cd40e48d2bad4ff8a4fd34e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4fc07e1-b1ce-4f1b-871e-70898f2421aa),volume_type_id=c4fc07e1-b1ce-4f1b-871e-70898f2421aa)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45de4ac-d7a9-4e52-89a4-20839b3354a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45de4ac-d7a9-4e52-89a4-20839b3354a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d34af2-38e2-4029-8908-20fca0f123d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d34af2-38e2-4029-8908-20fca0f123d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611', 'volume_name': 'volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46ce206-fa2c-4562-a012-3125efcb5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46ce206-fa2c-4562-a012-3125efcb5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22a10c9-5716-4de9-85b4-9054bbafb6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:02 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Volume ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611', 'volume_size': 1}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1329719179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8ba98ac0ea4ee9a29f2934ecad39f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:02Z,use_quota=True,user_id='e861c95cd40e48d2bad4ff8a4fd34e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4fc07e1-b1ce-4f1b-871e-70898f2421aa),volume_type_id=c4fc07e1-b1ce-4f1b-871e-70898f2421aa)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Creating volume ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:02 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:02 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 1073741824
Jun 17 04:07:02 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:02 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.701s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:07:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:07:03 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Deleted volume successfully.
Jun 17 04:07:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-380d8c05-b3b7-40f3-824e-4f9862861cf3 tempest-VolumesServicesTestJSON-610758552 None] Lock "cinder-585b8c04-82e8-489a-96ce-4bd221cec84c-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:03 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 1073741824" returned: 0 in 0.988s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:03 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611
Jun 17 04:07:03 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:04 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" returned: 0 in 0.693s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22a10c9-5716-4de9-85b4-9054bbafb6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ebbc06-773f-47fe-ae9f-4c528eb86737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Volume volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 (ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611): created successfully
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ebbc06-773f-47fe-ae9f-4c528eb86737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Flow 'volume_create_manager' (c85169d0-9126-4cab-9364-f0ccf0d2d4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:04 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dd6b5992-83e2-4683-9feb-7aacfcaf0c36 tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Created volume successfully.
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:05 devstack sudo[98238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:05 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:05 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.721s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:05 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4fb5abc6-13af-4b43-afbe-1a53040e916a tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Retype volume completed successfully.
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "cinder-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "cinder-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "cinder-quobyte-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "cinder-quobyte-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc93844-9f6c-4f5c-b906-3ed4d8058444]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:06 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611
Jun 17 04:07:06 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:07 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" returned: 0 in 0.816s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:07 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611
Jun 17 04:07:07 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:08 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" returned: 0 in 1.079s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "cinder-quobyte-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611" released by "delete_volume" :: held 1.970s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:08 devstack cinder-volume[92204]: WARNING cinder.quota [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:07:08 devstack cinder-volume[92204]: WARNING cinder.quota [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Created reservations ['9982e027-f8b7-43ac-84e6-13fc8acd11d2', '3fe88b68-b8be-4b2a-b803-1c9e1cc5b25d', 'aa1b63db-9a40-4859-9d0c-b12773f6a234', '4351bc2c-43a7-4b47-9fee-c19d01ea5834'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:08 devstack sudo[98640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:08 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:09 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.883s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:09 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Deleted volume successfully.
Jun 17 04:07:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-04078349-d458-4575-98c6-6650bae326eb tempest-VolumeRetypeWithoutMigrationTest-661178497 None] Lock "cinder-ce6de3a2-64a3-4fb2-8fa3-4b8f08f91611-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Flow 'volume_create_manager' (2dd00ec6-9939-40fe-9c4b-f060c3473b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4a3b11-9244-41e5-b3db-9a20a63d9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4a3b11-9244-41e5-b3db-9a20a63d9335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-890715487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36d8658-c67f-4cce-801a-057455d82787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df5510770604acabc88c991b2000f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:12Z,use_quota=True,user_id='6199d9eb0c4241b58299db0166a8316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b89707-a3a4-4ff0-afef-1f36751ed3e5),volume_type_id=e4b89707-a3a4-4ff0-afef-1f36751ed3e5)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e0ffbd-6877-4cba-8598-fd76f68637b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e0ffbd-6877-4cba-8598-fd76f68637b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b1e5cc-1881-4dad-8375-d19449241e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b1e5cc-1881-4dad-8375-d19449241e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36d8658-c67f-4cce-801a-057455d82787', 'volume_name': 'volume-d36d8658-c67f-4cce-801a-057455d82787', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02c0650-19aa-4297-b5ca-31d9879b4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02c0650-19aa-4297-b5ca-31d9879b4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ffab96-ce44-4623-991e-70c810d129de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:11 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Volume d36d8658-c67f-4cce-801a-057455d82787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36d8658-c67f-4cce-801a-057455d82787', 'volume_size': 1}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-890715487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36d8658-c67f-4cce-801a-057455d82787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df5510770604acabc88c991b2000f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:12Z,use_quota=True,user_id='6199d9eb0c4241b58299db0166a8316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b89707-a3a4-4ff0-afef-1f36751ed3e5),volume_type_id=e4b89707-a3a4-4ff0-afef-1f36751ed3e5)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Creating volume d36d8658-c67f-4cce-801a-057455d82787 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:11 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:11 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 1073741824
Jun 17 04:07:11 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:13 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 1073741824" returned: 0 in 1.109s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:13 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787
Jun 17 04:07:13 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:13 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787" returned: 0 in 0.632s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ffab96-ce44-4623-991e-70c810d129de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36d8658-c67f-4cce-801a-057455d82787', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bad2a6-d858-4127-9053-dbb0f1cc4be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Volume volume-d36d8658-c67f-4cce-801a-057455d82787 (d36d8658-c67f-4cce-801a-057455d82787): created successfully
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bad2a6-d858-4127-9053-dbb0f1cc4be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Flow 'volume_create_manager' (2dd00ec6-9939-40fe-9c4b-f060c3473b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-51a9806d-27d1-4910-8509-9116fd4fabe2 tempest-VolumeTypesAccessTest-187183853 None] Created volume successfully.
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Acquiring lock "cinder-d36d8658-c67f-4cce-801a-057455d82787-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "cinder-d36d8658-c67f-4cce-801a-057455d82787-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Acquiring lock "cinder-quobyte-d36d8658-c67f-4cce-801a-057455d82787" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "cinder-quobyte-d36d8658-c67f-4cce-801a-057455d82787" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f4eaf-6343-4e2a-aa78-0f69603e77ea]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:14 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787
Jun 17 04:07:14 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:15 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787" returned: 0 in 0.774s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:15 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787
Jun 17 04:07:15 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:15 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d36d8658-c67f-4cce-801a-057455d82787" returned: 0 in 0.790s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "cinder-quobyte-d36d8658-c67f-4cce-801a-057455d82787" released by "delete_volume" :: held 1.615s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:15 devstack cinder-volume[92204]: WARNING cinder.quota [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2078249128 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2078249128, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:07:15 devstack cinder-volume[92204]: WARNING cinder.quota [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2078249128 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2078249128, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Created reservations ['9db5097c-25af-4f6a-9284-411cce7b97bb', '169b9e35-cd52-4841-8e2a-8914afbad22b', 'c7e9448c-333b-419b-81fe-481cc8f8a278', 'c505c661-8252-4d59-a123-e3e1e2ac78e1'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:16 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:16 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:16 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.950s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:16 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Deleted volume successfully.
Jun 17 04:07:17 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba88ba26-9061-40cf-8160-ff39ff6f5998 tempest-VolumeTypesAccessTest-187183853 None] Lock "cinder-d36d8658-c67f-4cce-801a-057455d82787-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:25 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:07:26 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:07:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-67ed7027-b557-430d-bbd5-032c3cadeb48 req-d4925fed-e018-4762-942c-9374361baa72 tempest-AttachVolumeTestJSON-664675265 None] Terminate volume connection completed successfully.
Jun 17 04:07:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-67ed7027-b557-430d-bbd5-032c3cadeb48 req-d4925fed-e018-4762-942c-9374361baa72 tempest-AttachVolumeTestJSON-664675265 None] Deleting attachment ddb46dc5-6d55-4794-b99b-cdc273476b66. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (f68e8c51-9c89-4c84-bc92-09629d98e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c243e-49bb-44aa-a230-cd7f5ed6d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c243e-49bb-44aa-a230-cd7f5ed6d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-394779636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:37Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8836c0-1ff9-49fd-813d-3d9e97f76c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8836c0-1ff9-49fd-813d-3d9e97f76c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4676647-c4ef-4470-ac84-a703d71d27d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4676647-c4ef-4470-ac84-a703d71d27d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4', 'volume_name': 'volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ecf537-c645-4245-969a-24cb38b1aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ecf537-c645-4245-969a-24cb38b1aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef96962-4012-45cc-a88a-ec7c45ea86a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Volume 0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4', 'volume_size': 1}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-394779636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:37Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Creating volume 0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:37 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:37 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 1073741824
Jun 17 04:07:37 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:38 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 1073741824" returned: 0 in 0.916s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:38 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4
Jun 17 04:07:38 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:39 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" returned: 0 in 0.753s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef96962-4012-45cc-a88a-ec7c45ea86a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25562f52-d0b4-48d2-98c3-1eb0f6c490d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:39 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Volume volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 (0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4): created successfully
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25562f52-d0b4-48d2-98c3-1eb0f6c490d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (f68e8c51-9c89-4c84-bc92-09629d98e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d7357d15-055c-485f-b9f0-99b59e85c06b tempest-VolumesListAdminTestJSON-1294760632 None] Created volume successfully.
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (e3823a32-b139-44f8-98f1-cf7bbeaf8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41a91-7bcd-486c-9a03-a252cbbb85cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41a91-7bcd-486c-9a03-a252cbbb85cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1277199638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c4f10-5797-445a-a0c4-49b5520a2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:40Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6f64d-78df-4c4f-bf7a-d5df45ba0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6f64d-78df-4c4f-bf7a-d5df45ba0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b42247-a7db-4d3a-9ce0-dabbaa041056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b42247-a7db-4d3a-9ce0-dabbaa041056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661c4f10-5797-445a-a0c4-49b5520a2995', 'volume_name': 'volume-661c4f10-5797-445a-a0c4-49b5520a2995', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b553d0c-6886-4ac5-9cd6-8f31984c2088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b553d0c-6886-4ac5-9cd6-8f31984c2088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30710fb-9813-4792-b021-9fb7a8fe5e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:40 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Volume 661c4f10-5797-445a-a0c4-49b5520a2995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661c4f10-5797-445a-a0c4-49b5520a2995', 'volume_size': 1}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1277199638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c4f10-5797-445a-a0c4-49b5520a2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:40Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Creating volume 661c4f10-5797-445a-a0c4-49b5520a2995 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:40 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:40 devstack sudo[98873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 1073741824
Jun 17 04:07:40 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:41 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 1073741824" returned: 0 in 1.219s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:41 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995
Jun 17 04:07:41 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:42 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30710fb-9813-4792-b021-9fb7a8fe5e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661c4f10-5797-445a-a0c4-49b5520a2995', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0939f7-7faf-434d-9bfd-4b48226f2498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:42 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Volume volume-661c4f10-5797-445a-a0c4-49b5520a2995 (661c4f10-5797-445a-a0c4-49b5520a2995): created successfully
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0939f7-7faf-434d-9bfd-4b48226f2498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (e3823a32-b139-44f8-98f1-cf7bbeaf8087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6eda4f17-8f87-484c-99f9-1a3b69baf2bd tempest-VolumesListAdminTestJSON-1294760632 None] Created volume successfully.
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (7448d276-acaa-416a-87eb-b96969785209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f2af1a-c6e9-49f1-b4cf-3927f1de87ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f2af1a-c6e9-49f1-b4cf-3927f1de87ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693414733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa19015c-90e5-434a-97eb-265eccd34483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:44Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c2ca49-07cd-45ce-a9ad-ba9faac9936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c2ca49-07cd-45ce-a9ad-ba9faac9936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b976b729-0cb7-481b-bf50-12358ea0fbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b976b729-0cb7-481b-bf50-12358ea0fbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa19015c-90e5-434a-97eb-265eccd34483', 'volume_name': 'volume-fa19015c-90e5-434a-97eb-265eccd34483', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917ecab7-a0cf-4f6d-8920-4cde8714f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917ecab7-a0cf-4f6d-8920-4cde8714f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1ddca2-da05-47e5-ba1a-21019e45fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:43 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Volume fa19015c-90e5-434a-97eb-265eccd34483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa19015c-90e5-434a-97eb-265eccd34483', 'volume_size': 1}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693414733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa19015c-90e5-434a-97eb-265eccd34483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5080b128de42d9a2f3e039ab1334e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:44Z,use_quota=True,user_id='d37498c049bc4d2c85f43249b7ddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Creating volume fa19015c-90e5-434a-97eb-265eccd34483 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:43 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:43 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 1073741824
Jun 17 04:07:43 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:44 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 1073741824" returned: 0 in 1.040s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:45 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483
Jun 17 04:07:45 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:46 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483" returned: 0 in 1.002s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1ddca2-da05-47e5-ba1a-21019e45fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa19015c-90e5-434a-97eb-265eccd34483', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6ca82b-b463-41d5-b608-0b38b87bd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:46 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Volume volume-fa19015c-90e5-434a-97eb-265eccd34483 (fa19015c-90e5-434a-97eb-265eccd34483): created successfully
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6ca82b-b463-41d5-b608-0b38b87bd869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Flow 'volume_create_manager' (7448d276-acaa-416a-87eb-b96969785209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-67fb5c0e-12ec-4848-a3ee-e17364c0fd0c tempest-VolumesListAdminTestJSON-1294760632 None] Created volume successfully.
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Flow 'volume_create_manager' (a6d56c45-45fe-4a1d-b3cd-d9589df59da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef83618e-6769-4f00-bdcf-ab2f72fbf22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef83618e-6769-4f00-bdcf-ab2f72fbf22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d64767-4fe6-4c07-a354-a59f778ef25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b430f3aeae493985dff2d93bd7311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:48Z,use_quota=True,user_id='75367d9cb86542e8b35d5b4a064a1c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c1f9e9-a44d-4c37-b323-0b9886702a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c1f9e9-a44d-4c37-b323-0b9886702a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a80627e-f832-4848-bd8c-e146d4ad598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a80627e-f832-4848-bd8c-e146d4ad598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d64767-4fe6-4c07-a354-a59f778ef25a', 'volume_name': 'volume-f1d64767-4fe6-4c07-a354-a59f778ef25a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cebb0d-2377-4365-9b2d-f05a0ea3af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cebb0d-2377-4365-9b2d-f05a0ea3af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21a689e-dc44-42e7-82fb-fba46daaf266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:47 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Volume f1d64767-4fe6-4c07-a354-a59f778ef25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d64767-4fe6-4c07-a354-a59f778ef25a', 'volume_size': 1}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d64767-4fe6-4c07-a354-a59f778ef25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b430f3aeae493985dff2d93bd7311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:48Z,use_quota=True,user_id='75367d9cb86542e8b35d5b4a064a1c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Creating volume f1d64767-4fe6-4c07-a354-a59f778ef25a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:47 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:47 devstack sudo[98932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a 1073741824
Jun 17 04:07:47 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:48 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a 1073741824" returned: 0 in 0.775s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:48 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a
Jun 17 04:07:48 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:49 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a" returned: 0 in 0.609s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21a689e-dc44-42e7-82fb-fba46daaf266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d64767-4fe6-4c07-a354-a59f778ef25a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1547f68-0d46-435b-ab7b-27d7c33ad9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:49 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Volume volume-f1d64767-4fe6-4c07-a354-a59f778ef25a (f1d64767-4fe6-4c07-a354-a59f778ef25a): created successfully
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1547f68-0d46-435b-ab7b-27d7c33ad9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Flow 'volume_create_manager' (a6d56c45-45fe-4a1d-b3cd-d9589df59da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5c0acacb-fc5f-4125-9f26-8fb426575dc2 tempest-VolumesListAdminTestJSON-1174890070 None] Created volume successfully.
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Acquiring lock "cinder-f1d64767-4fe6-4c07-a354-a59f778ef25a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "cinder-f1d64767-4fe6-4c07-a354-a59f778ef25a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Acquiring lock "cinder-quobyte-f1d64767-4fe6-4c07-a354-a59f778ef25a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "cinder-quobyte-f1d64767-4fe6-4c07-a354-a59f778ef25a" acquired by "delete_volume" :: waited 0.054s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77e81b-2a80-443e-83ca-a792f4c1dcad]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-fa19015c-90e5-434a-97eb-265eccd34483-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-fa19015c-90e5-434a-97eb-265eccd34483-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-quobyte-fa19015c-90e5-434a-97eb-265eccd34483" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-fa19015c-90e5-434a-97eb-265eccd34483" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2e665c-e690-4140-9488-d646d1c15be3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:50 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a
Jun 17 04:07:50 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:50 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483
Jun 17 04:07:50 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:51 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a" returned: 0 in 1.188s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:51 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a
Jun 17 04:07:51 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:52 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483" returned: 0 in 1.947s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:52 devstack sudo[99036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483
Jun 17 04:07:52 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:52 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f1d64767-4fe6-4c07-a354-a59f778ef25a" returned: 0 in 1.227s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "cinder-quobyte-f1d64767-4fe6-4c07-a354-a59f778ef25a" released by "delete_volume" :: held 2.508s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Created reservations ['af741812-1522-46b7-9343-b7a8a07558e2', '1fe6d431-0d64-46d6-88b3-cff82a911b7d', '837ff318-778d-47b7-8f51-f0fce5e205ed', 'a94ecc09-a9fd-4aa8-b5b1-01f56d758a12'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:52 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:52 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Flow 'volume_create_manager' (003aca47-cb05-4ced-8e19-3e999019f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe40737-2857-4c88-ac8f-48b4de39625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe40737-2857-4c88-ac8f-48b4de39625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1449984047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3f2105-5dfe-480d-88aa-a08b7cac7d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259db7612a2243649826c4e6021c4a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:53Z,use_quota=True,user_id='cea9983228f441beb8ab397db7ea15b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173cf2d1-3aee-4ad3-8cc1-2c647fcc9e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173cf2d1-3aee-4ad3-8cc1-2c647fcc9e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7b4fe7-b1e5-4bc3-8597-02ffeb9398a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7b4fe7-b1e5-4bc3-8597-02ffeb9398a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3f2105-5dfe-480d-88aa-a08b7cac7d44', 'volume_name': 'volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd4548d-6cd0-4fc5-b343-fd2d7ee9feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd4548d-6cd0-4fc5-b343-fd2d7ee9feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bb9075-b4d1-4955-88af-aed902a50ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:53 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Volume cf3f2105-5dfe-480d-88aa-a08b7cac7d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44', 'volume_size': 1}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1449984047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3f2105-5dfe-480d-88aa-a08b7cac7d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259db7612a2243649826c4e6021c4a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:07:53Z,use_quota=True,user_id='cea9983228f441beb8ab397db7ea15b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Creating volume cf3f2105-5dfe-480d-88aa-a08b7cac7d44 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:07:53 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:53 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 1073741824
Jun 17 04:07:53 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:53 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fa19015c-90e5-434a-97eb-265eccd34483" returned: 0 in 1.704s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-fa19015c-90e5-434a-97eb-265eccd34483" released by "delete_volume" :: held 3.731s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Created reservations ['57db8d05-8754-47fe-844a-3d7a7dd98d6e', '628c6b1b-29a3-47f1-8e62-5c79ba7144f2', '6fae9448-5f92-490a-8a79-1ae39035085a', 'acecf496-c032-4c03-90a8-5f87d55bc1b1'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:54 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:54 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:54 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.527s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Deleted volume successfully.
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-54587c8e-a341-4416-b32d-fd2e26b6d814 tempest-VolumesListAdminTestJSON-1174890070 None] Lock "cinder-f1d64767-4fe6-4c07-a354-a59f778ef25a-delete_volume" released by "delete_volume" :: held 4.559s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:54 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 1073741824" returned: 0 in 1.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:54 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44
Jun 17 04:07:54 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-661c4f10-5797-445a-a0c4-49b5520a2995-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:55 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-661c4f10-5797-445a-a0c4-49b5520a2995-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.037s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Deleted volume successfully.
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-acd72e8e-5576-4bbb-a7de-8c5bc2544c80 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-fa19015c-90e5-434a-97eb-265eccd34483-delete_volume" released by "delete_volume" :: held 5.183s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-quobyte-661c4f10-5797-445a-a0c4-49b5520a2995" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-661c4f10-5797-445a-a0c4-49b5520a2995" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2f09d-608a-4c89-8b0b-5e8e7391e4af]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:55 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995
Jun 17 04:07:55 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:55 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" returned: 0 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] <== create_volume: return (2536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.539s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bb9075-b4d1-4955-88af-aed902a50ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f9e05-bf50-4656-a68e-456318872b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:07:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Volume volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 (cf3f2105-5dfe-480d-88aa-a08b7cac7d44): created successfully
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f9e05-bf50-4656-a68e-456318872b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:07:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Flow 'volume_create_manager' (003aca47-cb05-4ced-8e19-3e999019f087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:07:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0d47af3d-2dba-4fc5-9f56-bdf366620a4a tempest-AttachVolumeShelveTestJSON-185434045 None] Created volume successfully.
Jun 17 04:07:56 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995" returned: 0 in 0.774s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:56 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995
Jun 17 04:07:56 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:56 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-661c4f10-5797-445a-a0c4-49b5520a2995" returned: 0 in 0.736s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-661c4f10-5797-445a-a0c4-49b5520a2995" released by "delete_volume" :: held 1.566s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Created reservations ['a8a56835-83eb-4db7-a235-76da274db0ed', 'd2d78acd-39d7-4151-bdc5-cd9a8bc7f338', 'ae6fa51f-c61c-47a7-9029-845cee250ad6', 'c1162f1d-ff2e-4bc3-b6ee-79d394d246cf'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:57 devstack sudo[99085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:57 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:57 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:07:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Deleted volume successfully.
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "cinder-quobyte-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-48d5fb93-c1da-4c1d-8096-8905de986564 tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-661c4f10-5797-445a-a0c4-49b5520a2995-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4464d-c750-4898-88d2-90d2b5b86a9a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:07:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:58 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4
Jun 17 04:07:58 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:58 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" returned: 0 in 0.738s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:58 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4
Jun 17 04:07:58 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:07:59 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" returned: 0 in 0.818s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-quobyte-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4" released by "delete_volume" :: held 1.606s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Created reservations ['8e4a556f-0555-4aa2-98ca-987d684a9a0d', '5e01231f-ef73-47c1-8d00-aab2f03f9af8', 'adeba80c-919b-4f88-b074-82b3314be0a5', 'f2f542fb-3848-4f3c-ad03-5cfe88cfc622'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:07:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:07:59 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:07:59 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:00 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.030s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:00 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Deleted volume successfully.
Jun 17 04:08:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ac96d01d-aa99-47a0-99ca-46bd4e3f266f tempest-VolumesListAdminTestJSON-1294760632 None] Lock "cinder-0fc3db1a-5003-47e4-b6a2-f8c1544eb0a4-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:02 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:02 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:03 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.324s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:08:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:08:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (e5b675d1-04ed-43f9-b1f8-9bba683b0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48786df0-1037-4b6d-9fde-7857fcb3a35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48786df0-1037-4b6d-9fde-7857fcb3a35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1509225996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0347e4f-24a8-4db3-b047-1862f63b7511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:05Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9f76e3-a69c-407e-9b69-029ce700e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9f76e3-a69c-407e-9b69-029ce700e198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86dcef4-5af1-4e27-a6c6-10ca8e4d201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86dcef4-5af1-4e27-a6c6-10ca8e4d201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0347e4f-24a8-4db3-b047-1862f63b7511', 'volume_name': 'volume-a0347e4f-24a8-4db3-b047-1862f63b7511', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe3829-b14e-4818-a989-36dc1013ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe3829-b14e-4818-a989-36dc1013ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a97b50-b321-48fe-ac28-02449e20a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:05 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Volume a0347e4f-24a8-4db3-b047-1862f63b7511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0347e4f-24a8-4db3-b047-1862f63b7511', 'volume_size': 1}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1509225996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0347e4f-24a8-4db3-b047-1862f63b7511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:05Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Creating volume a0347e4f-24a8-4db3-b047-1862f63b7511 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:05 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:05 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 1073741824
Jun 17 04:08:05 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:06 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 1073741824" returned: 0 in 1.211s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:06 devstack sudo[99256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511
Jun 17 04:08:06 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:07 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511" returned: 0 in 0.704s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a97b50-b321-48fe-ac28-02449e20a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0347e4f-24a8-4db3-b047-1862f63b7511', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b33f08c-281d-4b10-99a4-4b3a64ad44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:07 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Volume volume-a0347e4f-24a8-4db3-b047-1862f63b7511 (a0347e4f-24a8-4db3-b047-1862f63b7511): created successfully
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b33f08c-281d-4b10-99a4-4b3a64ad44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (e5b675d1-04ed-43f9-b1f8-9bba683b0036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b06cbb36-eaef-4c1f-b687-93553cc2c545 tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-494b3521-f982-4f55-87f4-21e99ab55d47 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511" by "attach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-494b3521-f982-4f55-87f4-21e99ab55d47 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511" acquired by "attach_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-494b3521-f982-4f55-87f4-21e99ab55d47 tempest-VolumesActionsTest-391668070 None] Attaching volume a0347e4f-24a8-4db3-b047-1862f63b7511 to instance a86df533-89fe-41b2-a7ed-811605819181 at mountpoint /dev/vdb on host None.
Jun 17 04:08:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-494b3521-f982-4f55-87f4-21e99ab55d47 tempest-VolumesActionsTest-391668070 None] Attach volume completed successfully.
Jun 17 04:08:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-494b3521-f982-4f55-87f4-21e99ab55d47 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511" released by "attach_volume" :: held 0.125s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Terminate volume connection completed successfully.
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" by "detach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Detaching volume a0347e4f-24a8-4db3-b047-1862f63b7511 from instance a86df533-89fe-41b2-a7ed-811605819181.
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Flow 'volume_create_manager' (f180a4ce-78cd-43bf-b468-83b03cafb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50412308-835e-437f-87d3-5f54ae851b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50412308-835e-437f-87d3-5f54ae851b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-518530124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fcd1d6-a8c7-4769-b675-2a56fd4ae3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b4df4366a49ed97c33f98ee92841a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:10Z,use_quota=True,user_id='b99312b1792f46f28175d3951c68dc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea670d28-78c3-4329-ab0b-03e3d0d5a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea670d28-78c3-4329-ab0b-03e3d0d5a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435854bb-12fc-4147-be87-c276c4f1a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435854bb-12fc-4147-be87-c276c4f1a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fcd1d6-a8c7-4769-b675-2a56fd4ae3af', 'volume_name': 'volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe189e-dc2d-4b8c-b6a2-36f596e044cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe189e-dc2d-4b8c-b6a2-36f596e044cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e44ce-340d-488a-9b5b-6bb772132404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:10 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Volume 78fcd1d6-a8c7-4769-b675-2a56fd4ae3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af', 'volume_size': 1}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-518530124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fcd1d6-a8c7-4769-b675-2a56fd4ae3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b4df4366a49ed97c33f98ee92841a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:10Z,use_quota=True,user_id='b99312b1792f46f28175d3951c68dc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Creating volume 78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:10 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Detach volume completed successfully.
Jun 17 04:08:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-dc5e9c5e-941a-4979-97c3-27d1114959dc tempest-VolumesActionsTest-1760672614 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:10 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af 1073741824
Jun 17 04:08:10 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f69a447-3f00-4487-838b-4cc16469f6f3 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" by "detach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f69a447-3f00-4487-838b-4cc16469f6f3 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2f69a447-3f00-4487-838b-4cc16469f6f3 tempest-VolumesActionsTest-391668070 None] Volume detach called, but volume not attached.
Jun 17 04:08:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f69a447-3f00-4487-838b-4cc16469f6f3 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:12 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af 1073741824" returned: 0 in 1.611s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-quobyte-a0347e4f-24a8-4db3-b047-1862f63b7511" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "cinder-quobyte-a0347e4f-24a8-4db3-b047-1862f63b7511" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb11931-132d-4fba-9b31-e107960e7678]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:12 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af
Jun 17 04:08:12 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:12 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511
Jun 17 04:08:12 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:12 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e44ce-340d-488a-9b5b-6bb772132404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e93acc-69fd-45ae-b3a7-3564a1c21c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Volume volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af (78fcd1d6-a8c7-4769-b675-2a56fd4ae3af): created successfully
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e93acc-69fd-45ae-b3a7-3564a1c21c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Flow 'volume_create_manager' (f180a4ce-78cd-43bf-b468-83b03cafb071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2484ae4d-7eb6-4cb4-a954-955f3d9e7ad4 tempest-SnapshotMetadataTestJSON-1991955829 None] Created volume successfully.
Jun 17 04:08:13 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511" returned: 0 in 1.078s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:13 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511
Jun 17 04:08:13 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Creating offline snapshot 1c4ee125-c5fd-4793-9c4e-98fa880efc4a of volume 78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[193010e6-ca29-4b21-834c-ac456730bbce]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:14 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a0347e4f-24a8-4db3-b047-1862f63b7511" returned: 0 in 0.694s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "cinder-quobyte-a0347e4f-24a8-4db3-b047-1862f63b7511" released by "delete_volume" :: held 1.819s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Created reservations ['b7586958-5e85-48fd-b46a-60cc02a37820', 'fca561c9-f389-4670-aed3-5ef4575dac7d', 'a5319740-e3ca-4d1f-b677-6fcbc7e25b7f', 'b0f74d59-24ad-4b45-89fd-6e070d95df4e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:14 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af
Jun 17 04:08:14 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:14 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:14 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:15 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" returned: 0 in 1.032s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:15 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a 1G
Jun 17 04:08:15 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:15 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.045s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:15 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Deleted volume successfully.
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f555aa2a-7ef5-4bb3-8007-e6077f77de44 tempest-VolumesActionsTest-391668070 None] Lock "cinder-a0347e4f-24a8-4db3-b047-1862f63b7511-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-a8d3e3cb-65b6-48cd-8313-4af73c2c85ad req-84164300-c15c-437f-8873-6da12b02fb75 tempest-AttachVolumeShelveTestJSON-185434045 None] No connector for attachment 2acfdb86-d334-4ae8-a53c-2ea1b8f7c6c0; skipping storage backend terminate_connection call. {{(pid=92204) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}}
Jun 17 04:08:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-a8d3e3cb-65b6-48cd-8313-4af73c2c85ad req-84164300-c15c-437f-8873-6da12b02fb75 tempest-AttachVolumeShelveTestJSON-185434045 None] Deleting attachment 2acfdb86-d334-4ae8-a53c-2ea1b8f7c6c0. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:08:16 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a 1G" returned: 0 in 1.152s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:16 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a
Jun 17 04:08:16 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:17 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a" returned: 0 in 0.908s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:17 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a is being set with open permissions: ugo+rw
Jun 17 04:08:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:17 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a
Jun 17 04:08:17 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:17 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a" returned: 0 in 0.717s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:17 devstack sudo[99398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info
Jun 17 04:08:17 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:18 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:18 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info is being set with open permissions: ugo+rw
Jun 17 04:08:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:18 devstack sudo[99403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info
Jun 17 04:08:18 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:19 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.info" returned: 0 in 0.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.299s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-31b4e025-3119-471b-a8de-fcb67cd15508 tempest-SnapshotMetadataTestJSON-1991955829 None] Create snapshot completed successfully
Jun 17 04:08:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "cinder-1c4ee125-c5fd-4793-9c4e-98fa880efc4a-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-1c4ee125-c5fd-4793-9c4e-98fa880efc4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "cinder-quobyte-1c4ee125-c5fd-4793-9c4e-98fa880efc4a" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-1c4ee125-c5fd-4793-9c4e-98fa880efc4a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Deleting offline snapshot 1c4ee125-c5fd-4793-9c4e-98fa880efc4a of volume 78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] snapshot_file for this snap is: volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe5f7ee-4815-4bc0-bd04-f80588b0bf97]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:21 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a
Jun 17 04:08:21 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:21 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a" returned: 0 in 0.761s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7272259-9c34-4a33-9889-5fb8a5a24f1c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (05199601-24f5-4448-97f9-3061f9d1f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57a60dd-7744-49d7-8ccd-969d962ab3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57a60dd-7744-49d7-8ccd-969d962ab3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-168383404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18379a24-dc6c-40fc-913a-a6961ef87112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:22Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7865e2-bd9b-4281-92aa-4004ee504e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7865e2-bd9b-4281-92aa-4004ee504e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b3f24-cae3-4eaf-b821-430747e1180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:21 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b3f24-cae3-4eaf-b821-430747e1180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18379a24-dc6c-40fc-913a-a6961ef87112', 'volume_name': 'volume-18379a24-dc6c-40fc-913a-a6961ef87112', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:21 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91d3068-f89b-4d7c-ac88-7ffeb4d33f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91d3068-f89b-4d7c-ac88-7ffeb4d33f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c83336-11f3-49e3-a895-1d3c02faf036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Volume 18379a24-dc6c-40fc-913a-a6961ef87112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18379a24-dc6c-40fc-913a-a6961ef87112', 'volume_size': 1}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-168383404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18379a24-dc6c-40fc-913a-a6961ef87112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:22Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Creating volume 18379a24-dc6c-40fc-913a-a6961ef87112 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:22 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:22 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 1073741824
Jun 17 04:08:22 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:22 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:22 devstack sudo[99422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a
Jun 17 04:08:22 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:22 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 1073741824" returned: 0 in 0.836s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:22 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112
Jun 17 04:08:22 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:23 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a" returned: 0 in 0.710s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:23 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a
Jun 17 04:08:23 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:23 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c83336-11f3-49e3-a895-1d3c02faf036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18379a24-dc6c-40fc-913a-a6961ef87112', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26688b7d-bf87-41df-b07a-24da3c040092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Volume volume-18379a24-dc6c-40fc-913a-a6961ef87112 (18379a24-dc6c-40fc-913a-a6961ef87112): created successfully
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26688b7d-bf87-41df-b07a-24da3c040092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (05199601-24f5-4448-97f9-3061f9d1f994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e94195c6-f989-4796-9248-c6ed32b04085 tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:24 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af.1c4ee125-c5fd-4793-9c4e-98fa880efc4a" returned: 0 in 0.697s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-1c4ee125-c5fd-4793-9c4e-98fa880efc4a" released by "_delete_snapshot" :: held 3.031s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" released by "delete_snapshot" :: held 3.062s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:24 devstack cinder-volume[92204]: WARNING cinder.quota [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Created reservations ['1779a02a-bc55-4790-8588-b79c036b89ae', '908ffd12-e815-4f12-89c7-68f98fc20846', '84938c01-3d10-4d52-99be-5c765a16688f', 'ce9d1364-0430-490c-ac06-c2c962e81fec'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-18379a24-dc6c-40fc-913a-a6961ef87112-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-18379a24-dc6c-40fc-913a-a6961ef87112-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Delete snapshot completed successfully.
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8947eec7-486a-4777-af49-fdfe3cb1afec tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-1c4ee125-c5fd-4793-9c4e-98fa880efc4a-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-quobyte-18379a24-dc6c-40fc-913a-a6961ef87112" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-18379a24-dc6c-40fc-913a-a6961ef87112" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[46770a20-4d22-439c-8f49-d833ae61d896]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:24 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112
Jun 17 04:08:24 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:25 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112" returned: 0 in 0.789s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:25 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112
Jun 17 04:08:25 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "cinder-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[784369e3-69f1-4fc0-866e-a0242f04b6fb]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:25 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af
Jun 17 04:08:25 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:25 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-18379a24-dc6c-40fc-913a-a6961ef87112" returned: 0 in 0.799s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-18379a24-dc6c-40fc-913a-a6961ef87112" released by "delete_volume" :: held 1.649s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Created reservations ['8db66568-364a-4770-98ff-b27251299f22', '32b190a2-d6d0-4b55-8bad-3029376d7b89', '1276a721-a92c-4b45-870f-ea90c2bca978', 'c193bb3f-86a0-4e5e-b01b-dcabcd401c96'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=57,cinder:UPDATE=77,cinder:DELETE=7,cinder:INSERT=16 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:26 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:26 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:26 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" returned: 0 in 0.888s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:26 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af
Jun 17 04:08:26 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:26 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.652s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Deleted volume successfully.
Jun 17 04:08:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17c7c2af-4f27-4446-8592-ff2bbf97a155 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-18379a24-dc6c-40fc-913a-a6961ef87112-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:27 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" returned: 0 in 0.676s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (fdd33f40-d0cb-46e8-a8fb-10ca8e1a2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b863e2-e67f-4060-8123-d6d4fabe7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-quobyte-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af" released by "delete_volume" :: held 1.676s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=76,cinder:UPDATE=86,cinder:INSERT=23,cinder:DELETE=8 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b863e2-e67f-4060-8123-d6d4fabe7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-867053822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850f0c1f-6a08-46fb-a9c2-b8a5b27df709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:27Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd79f98f-9cf9-422e-869e-115c267932d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd79f98f-9cf9-422e-869e-115c267932d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05beb1c3-3236-40cd-a023-fbda970d8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05beb1c3-3236-40cd-a023-fbda970d8734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850f0c1f-6a08-46fb-a9c2-b8a5b27df709', 'volume_name': 'volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40215d3-6a60-4902-bd0f-caec45308ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40215d3-6a60-4902-bd0f-caec45308ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c594317-6ffa-4890-b538-26d81d022e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:27 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Volume 850f0c1f-6a08-46fb-a9c2-b8a5b27df709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709', 'volume_size': 1}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-867053822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850f0c1f-6a08-46fb-a9c2-b8a5b27df709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:27Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Creating volume 850f0c1f-6a08-46fb-a9c2-b8a5b27df709 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:27 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:27 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 1073741824
Jun 17 04:08:27 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Created reservations ['067fbabb-5cec-4802-bb3a-3cb474a8a7dc', '87d81c84-2b85-462d-bb89-d876cdcbc406', 'b83db0fb-8c76-4ee2-a102-679bd592bc7c', 'cee9e087-8cdf-4712-8e3c-fd341acd7355'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:27 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:27 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:28 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.072s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:28 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Deleted volume successfully.
Jun 17 04:08:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-82c7e791-2b30-40bd-badd-8eda21ec2945 tempest-SnapshotMetadataTestJSON-1991955829 None] Lock "cinder-78fcd1d6-a8c7-4769-b675-2a56fd4ae3af-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:28 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 1073741824" returned: 0 in 1.571s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:28 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709
Jun 17 04:08:28 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:29 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" returned: 0 in 0.817s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] <== create_volume: return (2443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c594317-6ffa-4890-b538-26d81d022e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9095553f-9a3f-42fe-86ae-e2c375aa62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Volume volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 (850f0c1f-6a08-46fb-a9c2-b8a5b27df709): created successfully
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9095553f-9a3f-42fe-86ae-e2c375aa62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (fdd33f40-d0cb-46e8-a8fb-10ca8e1a2943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:29 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9bde00ac-e86c-4a44-bf6b-062359e0808c tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-850f0c1f-6a08-46fb-a9c2-b8a5b27df709-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-850f0c1f-6a08-46fb-a9c2-b8a5b27df709-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-quobyte-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f0cd06-36aa-477a-9bb6-b6f2722969a8]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:30 devstack sudo[99496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709
Jun 17 04:08:30 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:31 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" returned: 0 in 0.843s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:31 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709
Jun 17 04:08:31 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (1fd71982-b66f-4a0a-b0e6-d3253871cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f9866-59c7-4e17-b9e1-1010b4d78027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f9866-59c7-4e17-b9e1-1010b4d78027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1190429914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ea8d71-973f-4080-9b55-a0017d7f1c1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:32Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353abaa7-d3c9-493d-b2ce-d57739c98718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353abaa7-d3c9-493d-b2ce-d57739c98718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9144c535-46bd-4b94-87aa-3daf0f5699f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9144c535-46bd-4b94-87aa-3daf0f5699f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ea8d71-973f-4080-9b55-a0017d7f1c1d', 'volume_name': 'volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00c3a6-02f8-4e09-9e37-aafd462c7b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00c3a6-02f8-4e09-9e37-aafd462c7b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb3aa24-ab1a-4531-a566-ede81b237d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:31 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Volume a6ea8d71-973f-4080-9b55-a0017d7f1c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d', 'volume_size': 1}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1190429914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ea8d71-973f-4080-9b55-a0017d7f1c1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:32Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Creating volume a6ea8d71-973f-4080-9b55-a0017d7f1c1d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:31 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:31 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d 1073741824
Jun 17 04:08:31 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:32 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" returned: 0 in 0.808s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-850f0c1f-6a08-46fb-a9c2-b8a5b27df709" released by "delete_volume" :: held 1.711s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Created reservations ['2b07710f-9c19-4494-9d8c-487e30dfd436', '4a9922f3-248d-4e68-933d-a8f9a058dd3a', 'ba931334-cbff-4540-8afa-faa78af70242', '163fb34e-c667-4726-a67e-ee998cc136e5'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:32 devstack sudo[99522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:32 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:33 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d 1073741824" returned: 0 in 1.113s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:33 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d
Jun 17 04:08:33 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:33 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.837s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Deleted volume successfully.
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bf3166f-a273-4748-87e2-2dae6f7bf0c0 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-850f0c1f-6a08-46fb-a9c2-b8a5b27df709-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (955ca88c-42b4-40f2-a460-5cfb5e21b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5d984d-9f3b-447f-a81b-66a6f9f2ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5d984d-9f3b-447f-a81b-66a6f9f2ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793325001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a74ca2b-ba54-41db-b87a-bd4c933be06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:33Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0c9553-378b-4db5-acf7-8e02281698ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0c9553-378b-4db5-acf7-8e02281698ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b206bd-aeef-4215-81c5-109f08d32c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b206bd-aeef-4215-81c5-109f08d32c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a74ca2b-ba54-41db-b87a-bd4c933be06e', 'volume_name': 'volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d352cb5-2336-437c-b855-f096ab07db3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d352cb5-2336-437c-b855-f096ab07db3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec5bd2-080f-4fa9-9e95-9784ea77d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Volume 7a74ca2b-ba54-41db-b87a-bd4c933be06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e', 'volume_size': 1}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:33 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" returned: 0 in 0.718s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793325001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a74ca2b-ba54-41db-b87a-bd4c933be06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:33Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Creating volume 7a74ca2b-ba54-41db-b87a-bd4c933be06e {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:33 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:33 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e 1073741824
Jun 17 04:08:33 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb3aa24-ab1a-4531-a566-ede81b237d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9b010-46ab-4881-8582-393c5bfb16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:33 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Volume volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d (a6ea8d71-973f-4080-9b55-a0017d7f1c1d): created successfully
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9b010-46ab-4881-8582-393c5bfb16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (1fd71982-b66f-4a0a-b0e6-d3253871cf86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6c61bdce-6aa1-45bd-980c-ecc47c3174c9 tempest-VolumesListTestJSON-956747362 None] Created volume successfully.
Jun 17 04:08:34 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e 1073741824" returned: 0 in 0.787s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:34 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e
Jun 17 04:08:34 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:35 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e" returned: 0 in 0.578s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec5bd2-080f-4fa9-9e95-9784ea77d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d415f3-6fdc-4ad0-a8f2-1c2d08459438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Volume volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e (7a74ca2b-ba54-41db-b87a-bd4c933be06e): created successfully
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d415f3-6fdc-4ad0-a8f2-1c2d08459438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (955ca88c-42b4-40f2-a460-5cfb5e21b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ee05ce83-7020-4dfe-a5f4-1d4d1a6633d6 tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (c1feda41-6f52-4ab9-8433-cb9a8d6759be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35bcd4c-6923-48e9-9b89-8fcc656d9829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35bcd4c-6923-48e9-9b89-8fcc656d9829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1568127324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbb0ca7-73bb-4275-a25a-76d3e51e04c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:35Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1097902-7e6f-4e57-a43d-82d5d8d90eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1097902-7e6f-4e57-a43d-82d5d8d90eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fc9c17-2061-406d-9678-054e58667e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fc9c17-2061-406d-9678-054e58667e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cbb0ca7-73bb-4275-a25a-76d3e51e04c7', 'volume_name': 'volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e162d3-f6d3-46dd-8dac-af833ed5f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e162d3-f6d3-46dd-8dac-af833ed5f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eab9dd-b479-4d8e-8c82-4c96c37f01f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Volume 3cbb0ca7-73bb-4275-a25a-76d3e51e04c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7', 'volume_size': 1}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1568127324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbb0ca7-73bb-4275-a25a-76d3e51e04c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:35Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Creating volume 3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:35 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:35 devstack sudo[99545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 1073741824
Jun 17 04:08:35 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-7a74ca2b-ba54-41db-b87a-bd4c933be06e-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-7a74ca2b-ba54-41db-b87a-bd4c933be06e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-quobyte-7a74ca2b-ba54-41db-b87a-bd4c933be06e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-7a74ca2b-ba54-41db-b87a-bd4c933be06e" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b1423-ea30-42c6-a19e-6cb25e76c487]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:36 devstack sudo[99547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e
Jun 17 04:08:36 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:36 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 1073741824" returned: 0 in 1.200s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:36 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7
Jun 17 04:08:36 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:37 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e" returned: 0 in 1.481s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:37 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e
Jun 17 04:08:37 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:38 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" returned: 0 in 1.297s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eab9dd-b479-4d8e-8c82-4c96c37f01f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e08c988-d9ba-4a4e-9ebc-8e80734e2d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:38 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Volume volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 (3cbb0ca7-73bb-4275-a25a-76d3e51e04c7): created successfully
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e08c988-d9ba-4a4e-9ebc-8e80734e2d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (c1feda41-6f52-4ab9-8433-cb9a8d6759be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7b7aaa07-6831-4b9b-b1ee-e8adef1161f2 tempest-VolumesListTestJSON-956747362 None] Created volume successfully.
Jun 17 04:08:38 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7a74ca2b-ba54-41db-b87a-bd4c933be06e" returned: 0 in 1.219s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-7a74ca2b-ba54-41db-b87a-bd4c933be06e" released by "delete_volume" :: held 2.759s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Created reservations ['faeb1eef-e5b9-4051-8e55-af57a8a742a1', 'aaffe12d-9f0c-475c-bcee-42666f73d877', 'ff070b35-b64b-4c1c-8728-3e45623c75fc', '5fb23db1-1992-42fd-b9dd-edf194496560'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:38 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:38 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:39 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.046s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:39 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Deleted volume successfully.
Jun 17 04:08:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-89b8413d-355e-482e-8d3f-c67cc27702c6 tempest-VolumesActionsTest-1760672614 None] Lock "cinder-7a74ca2b-ba54-41db-b87a-bd4c933be06e-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (82ca9f0d-ce72-469a-aa7a-83c4fec34625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796093d-faad-476e-aa7b-38b60e14d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796093d-faad-476e-aa7b-38b60e14d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1973540967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb408db7-a67c-4967-b3bc-e9458c0dfd2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:40Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7606c5-dc17-4cfb-974a-33ab2fc84228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7606c5-dc17-4cfb-974a-33ab2fc84228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50f1400-ae51-4ac6-96c4-9b394d08834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50f1400-ae51-4ac6-96c4-9b394d08834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb408db7-a67c-4967-b3bc-e9458c0dfd2a', 'volume_name': 'volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94643d0d-106d-4aec-a581-c00563e48daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94643d0d-106d-4aec-a581-c00563e48daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697eb140-adc0-4495-8306-297d422a6fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Volume bb408db7-a67c-4967-b3bc-e9458c0dfd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a', 'volume_size': 1}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1973540967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb408db7-a67c-4967-b3bc-e9458c0dfd2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2189ceb249ef4a1897bea04b68b27313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:40Z,use_quota=True,user_id='316d79b515e148c99b1636988b2b9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Creating volume bb408db7-a67c-4967-b3bc-e9458c0dfd2a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:40 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:40 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a 1073741824
Jun 17 04:08:40 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (0e7a814b-79b6-47b9-8aaf-ed84cc0d44e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55690892-009a-4f49-9b3e-03956eb2971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55690892-009a-4f49-9b3e-03956eb2971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231864047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a820174d-c48d-4974-8109-5b9e50c0e0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:40Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55905773-08d5-4148-8b52-5b7a485ab86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55905773-08d5-4148-8b52-5b7a485ab86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65ece6d-5de1-46cf-aff7-b7659a470e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65ece6d-5de1-46cf-aff7-b7659a470e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a820174d-c48d-4974-8109-5b9e50c0e0b7', 'volume_name': 'volume-a820174d-c48d-4974-8109-5b9e50c0e0b7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7cd97-6011-46eb-922a-e4b0c766b461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7cd97-6011-46eb-922a-e4b0c766b461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf47e55-1c76-4742-bc9d-c00e97406071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:40 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Volume a820174d-c48d-4974-8109-5b9e50c0e0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a820174d-c48d-4974-8109-5b9e50c0e0b7', 'volume_size': 1}
Jun 17 04:08:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:41 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a 1073741824" returned: 0 in 1.043s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:41 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a
Jun 17 04:08:41 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:42 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.489s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231864047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a820174d-c48d-4974-8109-5b9e50c0e0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:40Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Creating volume a820174d-c48d-4974-8109-5b9e50c0e0b7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:42 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:42 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 1073741824
Jun 17 04:08:42 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697eb140-adc0-4495-8306-297d422a6fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ee83c8-5c64-4b26-949e-09bdf8221960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:42 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Volume volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a (bb408db7-a67c-4967-b3bc-e9458c0dfd2a): created successfully
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ee83c8-5c64-4b26-949e-09bdf8221960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Flow 'volume_create_manager' (82ca9f0d-ce72-469a-aa7a-83c4fec34625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f72f34bc-8c9e-4848-8931-4344568b2be4 tempest-VolumesListTestJSON-956747362 None] Created volume successfully.
Jun 17 04:08:42 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 1073741824" returned: 0 in 0.847s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:42 devstack sudo[99698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7
Jun 17 04:08:42 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:43 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7" returned: 0 in 0.662s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf47e55-1c76-4742-bc9d-c00e97406071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a820174d-c48d-4974-8109-5b9e50c0e0b7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c419d6-ae34-44e0-8019-a18f3029bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:43 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Volume volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 (a820174d-c48d-4974-8109-5b9e50c0e0b7): created successfully
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c419d6-ae34-44e0-8019-a18f3029bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (0e7a814b-79b6-47b9-8aaf-ed84cc0d44e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3a7bf7f4-256b-4ef7-ae8d-c23955b9f6b8 tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-a820174d-c48d-4974-8109-5b9e50c0e0b7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "cinder-a820174d-c48d-4974-8109-5b9e50c0e0b7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Acquiring lock "cinder-quobyte-a820174d-c48d-4974-8109-5b9e50c0e0b7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-a820174d-c48d-4974-8109-5b9e50c0e0b7" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084cf3a-1d5e-4af1-b344-ff34b96d2077]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:45 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7
Jun 17 04:08:45 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-bb408db7-a67c-4967-b3bc-e9458c0dfd2a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-bb408db7-a67c-4967-b3bc-e9458c0dfd2a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:45 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7" returned: 0 in 0.780s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-quobyte-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:46 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7
Jun 17 04:08:46 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:46 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b14096a-f40e-43f3-a4cc-3ac77ecdf266]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:46 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a
Jun 17 04:08:46 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:47 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a820174d-c48d-4974-8109-5b9e50c0e0b7" returned: 0 in 1.213s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "cinder-quobyte-a820174d-c48d-4974-8109-5b9e50c0e0b7" released by "delete_volume" :: held 2.060s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Created reservations ['b021f68e-7ff9-43ca-a8f5-831ba5533ad7', 'ca8f8b38-82c4-4317-8702-1e61a265a909', 'f0093dd6-3a97-4920-a048-b852b43683b2', '37375369-bec0-46fa-9701-eab6fa253d0f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:47 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:47 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:47 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" returned: 0 in 1.791s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:47 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a
Jun 17 04:08:47 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:48 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.878s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:48 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Deleted volume successfully.
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9aae1d-60ea-49be-b89f-3230d939c66e tempest-VolumesActionsTest-1760672614 None] Lock "cinder-a820174d-c48d-4974-8109-5b9e50c0e0b7-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:48 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" returned: 0 in 0.859s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-bb408db7-a67c-4967-b3bc-e9458c0dfd2a" released by "delete_volume" :: held 2.722s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Created reservations ['034a91db-7492-4fd0-9382-2d29ba4ca5c8', '3f363013-6205-4390-ad14-6a6d8d7049dd', 'd20d1e95-1f42-4068-b760-e2044f23b527', '4e99b51f-a9ed-4b48-8114-1d763bc405bf'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:48 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:48 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (62ebd67e-b040-4548-8482-b9ac93aeeb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e153ec04-2983-4977-839c-e7eaab28c1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e153ec04-2983-4977-839c-e7eaab28c1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682960617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0591db86-5fa4-4cb4-ba3a-e538ca29555e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:50Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abacd79f-cf37-43e2-8511-89de6c6cd295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abacd79f-cf37-43e2-8511-89de6c6cd295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45194056-9c4f-4060-a2e9-1c3f1c59b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45194056-9c4f-4060-a2e9-1c3f1c59b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0591db86-5fa4-4cb4-ba3a-e538ca29555e', 'volume_name': 'volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade54ba1-9a22-4399-9732-08f061c16c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade54ba1-9a22-4399-9732-08f061c16c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab9db4f-a50f-48c8-ad2a-507c716771aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:49 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Volume 0591db86-5fa4-4cb4-ba3a-e538ca29555e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e', 'volume_size': 1}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682960617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0591db86-5fa4-4cb4-ba3a-e538ca29555e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f68798fca242869bb1c45417260716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:08:50Z,use_quota=True,user_id='7e4cfd396c254d85932920c28136acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Creating volume 0591db86-5fa4-4cb4-ba3a-e538ca29555e {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:08:49 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:49 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e 1073741824
Jun 17 04:08:49 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-quobyte-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d3331b-4d74-43b4-aba3-919672d14801]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:50 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.411s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Deleted volume successfully.
Jun 17 04:08:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ac66b21-7229-411b-ab88-951665e060c1 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-bb408db7-a67c-4967-b3bc-e9458c0dfd2a-delete_volume" released by "delete_volume" :: held 4.455s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:50 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7
Jun 17 04:08:50 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:51 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e 1073741824" returned: 0 in 1.454s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:51 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" returned: 0 in 1.216s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:51 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e
Jun 17 04:08:51 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:51 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7
Jun 17 04:08:51 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:52 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7" released by "delete_volume" :: held 2.033s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Created reservations ['f5e57cf9-faaa-479a-a36b-e2fdea0001e2', 'c0188363-dd35-463b-925c-6396e9aaceb2', '407ea3da-eb09-46c3-9af9-53f0bf2db536', '8755c168-c61e-4bf1-9623-52a8d3549c94'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:52 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e" returned: 0 in 0.862s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab9db4f-a50f-48c8-ad2a-507c716771aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a948f-d197-4453-b4d9-6ff1952de5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:08:52 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Volume volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e (0591db86-5fa4-4cb4-ba3a-e538ca29555e): created successfully
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a948f-d197-4453-b4d9-6ff1952de5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Flow 'volume_create_manager' (62ebd67e-b040-4548-8482-b9ac93aeeb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:08:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1c72a3d9-66f8-4a56-ba11-73228ffc7b45 tempest-VolumesActionsTest-391668070 None] Created volume successfully.
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:52 devstack sudo[99819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:52 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:52 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.678s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Deleted volume successfully.
Jun 17 04:08:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbcbff5-51f0-4691-9e22-d7a00643d811 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-3cbb0ca7-73bb-4275-a25a-76d3e51e04c7-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-a6ea8d71-973f-4080-9b55-a0017d7f1c1d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-a6ea8d71-973f-4080-9b55-a0017d7f1c1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "cinder-quobyte-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[70214401-1264-448c-b979-a6c350715e3a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:53 devstack sudo[99822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d
Jun 17 04:08:53 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-0591db86-5fa4-4cb4-ba3a-e538ca29555e-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "cinder-0591db86-5fa4-4cb4-ba3a-e538ca29555e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Acquiring lock "cinder-quobyte-0591db86-5fa4-4cb4-ba3a-e538ca29555e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "cinder-quobyte-0591db86-5fa4-4cb4-ba3a-e538ca29555e" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a259d-5eb0-4906-aa9c-c1205f3c6d18]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:08:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:53 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e
Jun 17 04:08:53 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:54 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" returned: 0 in 0.795s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:54 devstack sudo[99829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d
Jun 17 04:08:54 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:54 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e" returned: 0 in 0.769s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:54 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e
Jun 17 04:08:54 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:54 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" returned: 0 in 0.625s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-quobyte-a6ea8d71-973f-4080-9b55-a0017d7f1c1d" released by "delete_volume" :: held 1.462s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Created reservations ['802dca39-e7dc-4b66-a59f-c384a61f74b0', '96a48b75-4fc9-46df-9ce5-f3633f972a58', '0999f56f-1829-48b4-90e3-c986ea234bba', 'dcdd5dce-8553-41a4-9726-88aac7a99bf7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:55 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:55 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:55 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0591db86-5fa4-4cb4-ba3a-e538ca29555e" returned: 0 in 0.637s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "cinder-quobyte-0591db86-5fa4-4cb4-ba3a-e538ca29555e" released by "delete_volume" :: held 1.452s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Created reservations ['f25e0bf8-35d7-4783-a670-b3d623e32387', '7d892abe-1eb9-4de8-83d3-57974a842483', '23a8de5d-c532-43fe-bfa2-70a0de200453', '1649cdee-143d-4388-ac7c-dba0a02f04b6'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:08:55 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:08:55 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:08:55 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.629s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Deleted volume successfully.
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cee816c-e081-43b7-9098-3909369fac68 tempest-VolumesListTestJSON-956747362 None] Lock "cinder-a6ea8d71-973f-4080-9b55-a0017d7f1c1d-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:08:55 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.679s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:08:55 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:08:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Deleted volume successfully.
Jun 17 04:08:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-777c1a4b-6a36-48de-a02b-3ec8da328855 tempest-VolumesActionsTest-391668070 None] Lock "cinder-0591db86-5fa4-4cb4-ba3a-e538ca29555e-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:02 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:02 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:02 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.754s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 8 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:09:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:09:05 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=43,cinder:INSERT=18,cinder:UPDATE=89,cinder:DELETE=8 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:09:05 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=83,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=7 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "cinder-cf3f2105-5dfe-480d-88aa-a08b7cac7d44-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-cf3f2105-5dfe-480d-88aa-a08b7cac7d44-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "cinder-quobyte-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-quobyte-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87f58f-b563-4b14-9f93-73a89ffa2e62]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:12 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44
Jun 17 04:09:12 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (90a44d79-4bfb-4c4f-9e4e-87b3caafde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c225acf3-8338-45ab-85d7-d4628c68bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c225acf3-8338-45ab-85d7-d4628c68bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-778966293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46132436-7200-454f-b3d2-3f938f8d1599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:12Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42efc84-77b6-4cbb-9337-3f0e090afb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42efc84-77b6-4cbb-9337-3f0e090afb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfad887-5065-41dc-b880-75232aff1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfad887-5065-41dc-b880-75232aff1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46132436-7200-454f-b3d2-3f938f8d1599', 'volume_name': 'volume-46132436-7200-454f-b3d2-3f938f8d1599', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b792bb7-ca4c-4404-be8f-c89cc50c3446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b792bb7-ca4c-4404-be8f-c89cc50c3446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4970c35e-9712-4a19-987e-b4e7afba9a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:12 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Volume 46132436-7200-454f-b3d2-3f938f8d1599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46132436-7200-454f-b3d2-3f938f8d1599', 'volume_size': 1}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-778966293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46132436-7200-454f-b3d2-3f938f8d1599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:12Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Creating volume 46132436-7200-454f-b3d2-3f938f8d1599 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:12 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:12 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 1073741824
Jun 17 04:09:12 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:12 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" returned: 0 in 0.954s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:12 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44
Jun 17 04:09:12 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:13 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 1073741824" returned: 0 in 1.128s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:13 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599
Jun 17 04:09:13 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:13 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" returned: 0 in 0.679s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-quobyte-cf3f2105-5dfe-480d-88aa-a08b7cac7d44" released by "delete_volume" :: held 1.683s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Created reservations ['e6e848a0-1395-46d9-ae3a-2e7c23b500a9', '7cd9131c-3205-46bd-9af0-ab2698f25695', 'f74ed505-6042-427b-8f59-5e9f91e0734b', '860b5524-6437-4440-98ac-5ce5c820d1d8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:13 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:13 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "cinder-86eb14d0-6f30-4786-a56f-0724dab922cf-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:14 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599" returned: 0 in 0.969s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-86eb14d0-6f30-4786-a56f-0724dab922cf-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4970c35e-9712-4a19-987e-b4e7afba9a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46132436-7200-454f-b3d2-3f938f8d1599', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1940d6-8e8c-4bb2-aed8-06e39f5a9af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:14 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Volume volume-46132436-7200-454f-b3d2-3f938f8d1599 (46132436-7200-454f-b3d2-3f938f8d1599): created successfully
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1940d6-8e8c-4bb2-aed8-06e39f5a9af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (90a44d79-4bfb-4c4f-9e4e-87b3caafde62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "cinder-quobyte-86eb14d0-6f30-4786-a56f-0724dab922cf" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9ff676b2-7ef7-4ad6-8f30-ee372ba451a8 tempest-AttachVolumeTestJSON-664675265 None] Created volume successfully.
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-quobyte-86eb14d0-6f30-4786-a56f-0724dab922cf" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef20831-debf-4599-a786-ddf76bcd602a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:14 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.875s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Deleted volume successfully.
Jun 17 04:09:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c26c3fb3-14ec-4a29-af95-7676eec381de tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-cf3f2105-5dfe-480d-88aa-a08b7cac7d44-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:14 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf
Jun 17 04:09:14 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:15 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:15 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf
Jun 17 04:09:15 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:16 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb14d0-6f30-4786-a56f-0724dab922cf" returned: 0 in 0.882s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-quobyte-86eb14d0-6f30-4786-a56f-0724dab922cf" released by "delete_volume" :: held 1.693s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Created reservations ['28f66a24-0840-40f9-96e2-ae3a688935cd', 'c1011b33-abd2-4567-9281-42c010673e60', 'fb8fffc5-c634-45d5-807b-d2046dc2c7dd', 'fa5fbab7-64fc-46c6-9171-ff716a5105f9'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:16 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:16 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:17 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.725s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:17 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Deleted volume successfully.
Jun 17 04:09:17 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b7e16b0e-8707-4008-a61a-58a54a216565 tempest-AttachVolumeShelveTestJSON-185434045 None] Lock "cinder-86eb14d0-6f30-4786-a56f-0724dab922cf-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[66779278-609a-446c-b566-61fff1c0b0f7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:18 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599
Jun 17 04:09:18 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Flow 'volume_create_manager' (11fd4193-5cc4-4e42-8309-7d1fde1f38d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fcdb9a-a8f9-41d4-83ff-63f36f32b9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fcdb9a-a8f9-41d4-83ff-63f36f32b9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1246793592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f98488-cc67-46cb-8f6f-945653f7f021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d446615a01a4a2e9c596dd3f98f6d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:19Z,use_quota=True,user_id='965290b49ea743608ad0be153df6274c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10b8c44-39c0-49ab-b921-24d4f26b86e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10b8c44-39c0-49ab-b921-24d4f26b86e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44ee476-3dbb-4c85-b576-90e2d5ed8fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:18 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44ee476-3dbb-4c85-b576-90e2d5ed8fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8f98488-cc67-46cb-8f6f-945653f7f021', 'volume_name': 'volume-b8f98488-cc67-46cb-8f6f-945653f7f021', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b92c920>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd652d7b-a188-48be-a38e-e683edc5b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd652d7b-a188-48be-a38e-e683edc5b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95bcdd-df09-44db-89bc-9b2b9a3357c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Volume b8f98488-cc67-46cb-8f6f-945653f7f021: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8f98488-cc67-46cb-8f6f-945653f7f021', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b92c920>}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Trying to clone b8f98488-cc67-46cb-8f6f-945653f7f021 from image 6b933bbd-ad87-411f-8a67-3350ca673beb at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:09:19 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599" returned: 0 in 1.094s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.129s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-46132436-7200-454f-b3d2-3f938f8d1599', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba662d73-3896-43ae-ba87-bd4f4953c8bb', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:09:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-1eb6e674-4d9a-490f-8e74-eebf83218120 req-9fc0e2f2-36f7-42af-8dfe-a1f475c94aad tempest-AttachVolumeTestJSON-664675265 None] attachment_update completed successfully.
Jun 17 04:09:20 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:09:20 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Image download 20.69 MB at 20.69 MB/s
Jun 17 04:09:20 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e096da-e1a2-4da7-9c25-56696ff9b61b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:20 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD
Jun 17 04:09:20 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:21 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:21 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb is fetched for user 965290b49ea743608ad0be153df6274c. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:09:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53f2f98-953b-480e-954c-e0ffc963832a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:21 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD
Jun 17 04:09:21 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:22 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1246793592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f98488-cc67-46cb-8f6f-945653f7f021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d446615a01a4a2e9c596dd3f98f6d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:19Z,use_quota=True,user_id='965290b49ea743608ad0be153df6274c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Creating volume b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:22 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:22 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1073741824
Jun 17 04:09:22 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:23 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1073741824" returned: 0 in 1.185s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:23 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:23 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:24 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 0 in 0.863s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Attempting download of 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume b8f98488-cc67-46cb-8f6f-945653f7f021. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c59dc5-db72-4cd0-b1cd-4faff8db6ce8]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:24 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im
Jun 17 04:09:24 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:25 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im" returned: 0 in 0.767s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:25 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im
Jun 17 04:09:25 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Flow 'volume_create_manager' (4df95b4e-4939-4973-a4c7-b0271fe6d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0338dacc-171e-4c38-80db-c8eadb08d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0338dacc-171e-4c38-80db-c8eadb08d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-787765332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57c6d96-4283-40ab-9159-41de5b21d4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7f419660e46c7ab29f2d3ba156f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:25Z,use_quota=True,user_id='f4240e2b3ade42e19f512b8cd2d87771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c11d04-98cd-4b02-bf06-6b138236c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c11d04-98cd-4b02-bf06-6b138236c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb13ac8-80cc-435b-8e1c-307610d695e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb13ac8-80cc-435b-8e1c-307610d695e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57c6d96-4283-40ab-9159-41de5b21d4c7', 'volume_name': 'volume-f57c6d96-4283-40ab-9159-41de5b21d4c7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d3c5c6-e434-4266-b727-c6e1e8057e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d3c5c6-e434-4266-b727-c6e1e8057e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64a2e62-3fce-4204-9814-87c18e71782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Volume f57c6d96-4283-40ab-9159-41de5b21d4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57c6d96-4283-40ab-9159-41de5b21d4c7', 'volume_size': 1}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-787765332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57c6d96-4283-40ab-9159-41de5b21d4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7f419660e46c7ab29f2d3ba156f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:25Z,use_quota=True,user_id='f4240e2b3ade42e19f512b8cd2d87771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Creating volume f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:25 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:25 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 1073741824
Jun 17 04:09:25 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Flow 'volume_create_manager' (c58be288-4982-42b2-925e-e35525f9e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43638c1f-023f-4c99-958b-110255db694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43638c1f-023f-4c99-958b-110255db694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-840831612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d726ed2c-a166-474d-a1e7-36dae149b170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743178942e4440eb812bed301da5f095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:26Z,use_quota=True,user_id='b1a50d4d8e4a4fde94d3a5a0e68fe2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13364b6c-b150-4882-84b4-a4d14720e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13364b6c-b150-4882-84b4-a4d14720e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb8218-5aad-47a3-b349-ce5a4c3f4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (016c1c9a-ffd1-4e8c-a68f-57ca182d2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb89f82-05bb-42f8-b5c6-767fa4ae438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb89f82-05bb-42f8-b5c6-767fa4ae438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2088389683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131d3b8d-1d89-4c38-a45f-2c6a0e3f2605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:26Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5747a6b7-9930-4489-9356-b5bf70bc4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5747a6b7-9930-4489-9356-b5bf70bc4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63aeb435-210f-4f16-a9d6-8c58793e9e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63aeb435-210f-4f16-a9d6-8c58793e9e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131d3b8d-1d89-4c38-a45f-2c6a0e3f2605', 'volume_name': 'volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:26 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34135316-8752-4002-88d1-6a002ec48675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34135316-8752-4002-88d1-6a002ec48675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef69009-dce5-4f53-bff2-c732f2f0aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Volume 131d3b8d-1d89-4c38-a45f-2c6a0e3f2605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605', 'volume_size': 1}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im" returned: 1 in 0.932s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_4y23v5im' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d13efa-f8cc-424c-9a5d-6f94548efabd]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb8218-5aad-47a3-b349-ce5a4c3f4482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd726ed2c-a166-474d-a1e7-36dae149b170', 'volume_name': 'volume-d726ed2c-a166-474d-a1e7-36dae149b170', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b6fd310>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe3b7a-5f81-4aff-aa5e-11a4874a07a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe3b7a-5f81-4aff-aa5e-11a4874a07a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e0f39-661f-4785-9b2a-76a8062d78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Volume d726ed2c-a166-474d-a1e7-36dae149b170: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d726ed2c-a166-474d-a1e7-36dae149b170', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b6fd310>}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Trying to clone d726ed2c-a166-474d-a1e7-36dae149b170 from image 6b933bbd-ad87-411f-8a67-3350ca673beb at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:09:26 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD
Jun 17 04:09:26 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:09:26 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Image download 20.69 MB at 20.69 MB/s
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976ee0b-31ca-47a4-b503-3d6e3ea775a5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:26 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 1073741824" returned: 0 in 1.002s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:26 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD
Jun 17 04:09:26 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:26 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7
Jun 17 04:09:26 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:26 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] 6b933bbd-ad87-411f-8a67-3350ca673beb was qcow2, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:09:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:26 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:26 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:27 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2088389683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131d3b8d-1d89-4c38-a45f-2c6a0e3f2605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30d179d9f44f1d907eff45bbe3e06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:26Z,use_quota=True,user_id='a82ba8f429eb43f3becfe0cae0fd65f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Creating volume 131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:27 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:27 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb is fetched for user b1a50d4d8e4a4fde94d3a5a0e68fe2b6. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64a2e62-3fce-4204-9814-87c18e71782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57c6d96-4283-40ab-9159-41de5b21d4c7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:27 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 1073741824
Jun 17 04:09:27 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d02b1-df93-454a-8517-e1d7fde72278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:27 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Volume volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 (f57c6d96-4283-40ab-9159-41de5b21d4c7): created successfully
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d02b1-df93-454a-8517-e1d7fde72278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Flow 'volume_create_manager' (4df95b4e-4939-4973-a4c7-b0271fe6d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-f3a84357-e1ac-4c36-bd5a-55b849bd2567 req-5f18f534-558a-42d9-9320-aef18307e280 tempest-VolumesSnapshotsTestJSON-1036340950 None] Created volume successfully.
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e572a-44ef-4f05-9dac-a946668fcd85]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:27 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD
Jun 17 04:09:27 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:28 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:28 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 1073741824" returned: 0 in 0.965s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:28 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605
Jun 17 04:09:28 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:28 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" returned: 0 in 0.652s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-840831612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d726ed2c-a166-474d-a1e7-36dae149b170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743178942e4440eb812bed301da5f095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:26Z,use_quota=True,user_id='b1a50d4d8e4a4fde94d3a5a0e68fe2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Creating volume d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:28 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:28 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 0 in 2.057s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_vhwl6egzdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:09:28 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Converted 112.00 MB image at 54.41 MB/s
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:28 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1073741824
Jun 17 04:09:28 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef69009-dce5-4f53-bff2-c732f2f0aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:28 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1G
Jun 17 04:09:28 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf067c8-29ab-476f-bac6-74cf0a58f0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Volume volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 (131d3b8d-1d89-4c38-a45f-2c6a0e3f2605): created successfully
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf067c8-29ab-476f-bac6-74cf0a58f0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Flow 'volume_create_manager' (016c1c9a-ffd1-4e8c-a68f-57ca182d2f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8e35e16e-33b3-431c-8f4c-2f19dd57c259 tempest-AttachVolumeTestJSON-664675265 None] Created volume successfully.
Jun 17 04:09:29 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 1G" returned: 0 in 0.637s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136ff9b-cf58-4928-b9e9-0305c9f97385]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:29 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1073741824" returned: 0 in 0.779s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:29 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:29 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:29 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:29 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:30 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 0.584s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.078s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:30 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 0 in 0.733s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Creating offline snapshot 8842a703-8694-4ed2-ae51-496fe1f99ffe of volume f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a30759-2c5b-4658-8e36-6a5a8bec22db]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Attempting download of 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume d726ed2c-a166-474d-a1e7-36dae149b170. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e120c10-cf24-4cce-b014-75f220253cf7]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:30 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:30 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:30 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7
Jun 17 04:09:30 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:30 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9
Jun 17 04:09:30 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:31 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:31 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:31 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 1 in 0.766s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Downloaded image 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume b8f98488-cc67-46cb-8f6f-945653f7f021 successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb for user 965290b49ea743608ad0be153df6274c is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Marking volume b8f98488-cc67-46cb-8f6f-945653f7f021 as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:09:31 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe 1G
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:31 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Copying metadata from image 6b933bbd-ad87-411f-8a67-3350ca673beb to b8f98488-cc67-46cb-8f6f-945653f7f021. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Creating volume glance metadata for volume b8f98488-cc67-46cb-8f6f-945653f7f021 backed by image 6b933bbd-ad87-411f-8a67-3350ca673beb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95bcdd-df09-44db-89bc-9b2b9a3357c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f98488-cc67-46cb-8f6f-945653f7f021', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b92c920>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7e7b3d-0e04-421b-b85a-2831c8af54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:31 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9
Jun 17 04:09:31 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:31 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Volume volume-b8f98488-cc67-46cb-8f6f-945653f7f021 (b8f98488-cc67-46cb-8f6f-945653f7f021): created successfully
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7e7b3d-0e04-421b-b85a-2831c8af54bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Flow 'volume_create_manager' (11fd4193-5cc4-4e42-8309-7d1fde1f38d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-95ff3180-100a-426d-92a2-761701d07233 tempest-VolumesImageMetadata-17547126 None] Created volume successfully.
Jun 17 04:09:31 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9" returned: 1 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_7c5nijg9' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd355e-c01c-429d-ab50-645152feeb19]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:31 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe 1G" returned: 0 in 0.812s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:31 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe
Jun 17 04:09:31 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:31 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD
Jun 17 04:09:31 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Acquiring lock "cinder-b8f98488-cc67-46cb-8f6f-945653f7f021-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "cinder-b8f98488-cc67-46cb-8f6f-945653f7f021-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:32 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] 6b933bbd-ad87-411f-8a67-3350ca673beb was qcow2, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Acquiring lock "cinder-quobyte-b8f98488-cc67-46cb-8f6f-945653f7f021" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:32 devstack sudo[100527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:32 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "cinder-quobyte-b8f98488-cc67-46cb-8f6f-945653f7f021" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd9de9-6a27-4007-8555-f7a0fa95eed7]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:32 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe" returned: 0 in 0.828s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:32 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe is being set with open permissions: ugo+rw
Jun 17 04:09:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:32 devstack sudo[100530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe
Jun 17 04:09:32 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:32 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:32 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:33 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe" returned: 0 in 0.659s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:33 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info
Jun 17 04:09:33 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:33 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 0 in 0.791s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:33 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:33 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:34 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info" returned: 0 in 0.724s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:34 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info is being set with open permissions: ugo+rw
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:34 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info
Jun 17 04:09:34 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:34 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 1 in 0.798s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:34 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021
Jun 17 04:09:34 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:34 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 2.178s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_774xbkxcdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:09:34 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Converted 112.00 MB image at 51.39 MB/s
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:34 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1G
Jun 17 04:09:34 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:34 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.info" returned: 0 in 0.692s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.570s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.515s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb023fc-822f-41af-bb87-623d2a0e13b0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-dce6ff68-4b20-420d-bba1-6ba3f1518015 req-fcf8cd48-274a-4dba-b325-ae4e0f55c48a tempest-VolumesSnapshotsTestJSON-1036340950 None] Create snapshot completed successfully
Jun 17 04:09:34 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f98488-cc67-46cb-8f6f-945653f7f021" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "cinder-quobyte-b8f98488-cc67-46cb-8f6f-945653f7f021" released by "delete_volume" :: held 2.301s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Created reservations ['65d76335-8ee3-425a-b8eb-87e9196519f5', '956fe59c-4bc6-489a-9cc2-d6ff0f607b67', '0627b57d-f100-4cca-b9a6-ac284b83df15', '9812d37a-d763-477d-9a10-94139fd70fa7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:35 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605
Jun 17 04:09:35 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:35 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:35 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:35 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 1G" returned: 0 in 0.699s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e18e4-fdfc-4d43-be12-8db04090f113]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:35 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:35 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:35 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" returned: 0 in 0.738s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96e9b1a1-112a-4eac-bc04-4d1c010b35e2', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:09:35 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.621s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Deleted volume successfully.
Jun 17 04:09:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-1031f04b-cb36-4c5c-a7aa-b7b4fb12ba72 req-cad2959a-284f-488a-b80a-2c989019a7ba tempest-AttachVolumeTestJSON-664675265 None] attachment_update completed successfully.
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-847dada3-3fd4-47f0-bd93-9c69bb6213fe tempest-VolumesImageMetadata-17547126 None] Lock "cinder-b8f98488-cc67-46cb-8f6f-945653f7f021-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "cinder-8842a703-8694-4ed2-ae51-496fe1f99ffe-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-8842a703-8694-4ed2-ae51-496fe1f99ffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "cinder-quobyte-8842a703-8694-4ed2-ae51-496fe1f99ffe" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-8842a703-8694-4ed2-ae51-496fe1f99ffe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Deleting offline snapshot 8842a703-8694-4ed2-ae51-496fe1f99ffe of volume f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] snapshot_file for this snap is: volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa01d6-ffcd-4715-8793-15f1294ffdc2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:36 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe
Jun 17 04:09:36 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:36 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 0.771s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:36 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:36 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:36 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe" returned: 0 in 0.837s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f57c6d96-4283-40ab-9159-41de5b21d4c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedaa25-345a-467a-8eb4-467789fd3b86]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:37 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 1 in 0.766s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Downloaded image 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume d726ed2c-a166-474d-a1e7-36dae149b170 successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb for user b1a50d4d8e4a4fde94d3a5a0e68fe2b6 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Marking volume d726ed2c-a166-474d-a1e7-36dae149b170 as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Copying metadata from image 6b933bbd-ad87-411f-8a67-3350ca673beb to d726ed2c-a166-474d-a1e7-36dae149b170. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Creating volume glance metadata for volume d726ed2c-a166-474d-a1e7-36dae149b170 backed by image 6b933bbd-ad87-411f-8a67-3350ca673beb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:09:37 devstack sudo[100589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7
Jun 17 04:09:37 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e0f39-661f-4785-9b2a-76a8062d78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d726ed2c-a166-474d-a1e7-36dae149b170', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b6fd310>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3ba72e-1e60-40d4-98e5-1b3e0b7563fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Volume volume-d726ed2c-a166-474d-a1e7-36dae149b170 (d726ed2c-a166-474d-a1e7-36dae149b170): created successfully
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3ba72e-1e60-40d4-98e5-1b3e0b7563fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Flow 'volume_create_manager' (c58be288-4982-42b2-925e-e35525f9e345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-52d3e418-529d-47fb-acc4-9f548774b9fa tempest-TestShelveInstance-765217980 None] Created volume successfully.
Jun 17 04:09:37 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7" returned: 0 in 0.859s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:37 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe
Jun 17 04:09:37 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:38 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe" returned: 0 in 0.813s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:38 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe
Jun 17 04:09:38 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:39 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7.8842a703-8694-4ed2-ae51-496fe1f99ffe" returned: 0 in 0.647s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-8842a703-8694-4ed2-ae51-496fe1f99ffe" released by "_delete_snapshot" :: held 3.295s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" released by "delete_snapshot" :: held 3.320s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:39 devstack cinder-volume[92204]: DEBUG cinder.quota [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Created reservations ['eee25b0c-7ede-4864-9459-6032738a3234', '0d67c83d-648c-4569-8b79-eb62bde1ef29', '1ee1df34-a927-404f-bdd4-468b0ab36167', 'b9469432-9b27-44a8-bf02-2ea18883b861'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Delete snapshot completed successfully.
Jun 17 04:09:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-55678eb1-d4b7-46a0-a488-f951f852dade req-d2553346-fa4f-4305-94c6-408922937642 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-8842a703-8694-4ed2-ae51-496fe1f99ffe-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Flow 'volume_create_manager' (1d520585-3f87-4ab8-b423-509580bc65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f237e8d-eaf7-47e2-9b23-e2dd7acf01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f237e8d-eaf7-47e2-9b23-e2dd7acf01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-544697216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695d6650-16eb-4117-9c5a-df228c633914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99757d396ff140ac8c50494c941dc597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:40Z,use_quota=True,user_id='23471353e4ae40ff8b1668a04e536412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639f7976-4af9-4518-9135-6e89923480bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639f7976-4af9-4518-9135-6e89923480bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad51bf49-3c8e-4e76-a121-54793d2f9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad51bf49-3c8e-4e76-a121-54793d2f9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695d6650-16eb-4117-9c5a-df228c633914', 'volume_name': 'volume-695d6650-16eb-4117-9c5a-df228c633914', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962c9df0-6c57-47a1-bfa4-4c5450c7db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962c9df0-6c57-47a1-bfa4-4c5450c7db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d698476-6335-4eac-a574-63349abd4e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:40 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Volume 695d6650-16eb-4117-9c5a-df228c633914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695d6650-16eb-4117-9c5a-df228c633914', 'volume_size': 1}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-544697216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695d6650-16eb-4117-9c5a-df228c633914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99757d396ff140ac8c50494c941dc597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:40Z,use_quota=True,user_id='23471353e4ae40ff8b1668a04e536412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Creating volume 695d6650-16eb-4117-9c5a-df228c633914 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:40 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:40 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 1073741824
Jun 17 04:09:40 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "cinder-f57c6d96-4283-40ab-9159-41de5b21d4c7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-f57c6d96-4283-40ab-9159-41de5b21d4c7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbd7d9-b78b-4893-8f98-0eacf194e041]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:40 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7
Jun 17 04:09:40 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:40 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 1073741824" returned: 0 in 0.843s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:41 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914
Jun 17 04:09:41 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:41 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7" returned: 0 in 0.750s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:41 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7
Jun 17 04:09:41 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-60fe1ce0-cd7c-4d87-9bf8-5384271e0341 req-ebed7dfd-7479-4164-8f93-cf2f18c6a8c2 tempest-AttachVolumeTestJSON-664675265 None] Terminate volume connection completed successfully.
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-60fe1ce0-cd7c-4d87-9bf8-5384271e0341 req-ebed7dfd-7479-4164-8f93-cf2f18c6a8c2 tempest-AttachVolumeTestJSON-664675265 None] Deleting attachment ba662d73-3896-43ae-ba87-bd4f4953c8bb. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:09:41 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d698476-6335-4eac-a574-63349abd4e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695d6650-16eb-4117-9c5a-df228c633914', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbf3d65-b6f1-4561-b21c-a1d50f048987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:41 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Volume volume-695d6650-16eb-4117-9c5a-df228c633914 (695d6650-16eb-4117-9c5a-df228c633914): created successfully
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbf3d65-b6f1-4561-b21c-a1d50f048987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Flow 'volume_create_manager' (1d520585-3f87-4ab8-b423-509580bc65c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e9192e70-be9c-42fb-a44d-0f7916d0a698 tempest-AbsoluteLimitsTests-309971387 None] Created volume successfully.
Jun 17 04:09:41 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f57c6d96-4283-40ab-9159-41de5b21d4c7" returned: 0 in 0.641s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-quobyte-f57c6d96-4283-40ab-9159-41de5b21d4c7" released by "delete_volume" :: held 1.489s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.quota [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Created reservations ['0bcca89a-25ae-4821-8de1-64e50712ab4a', '2000f347-3a76-4de8-9f53-7b81f9d1f9cf', '28b22d19-f17c-4cb3-92f9-23eab6043ffb', '1378f0d8-9ed4-4ee7-9d3f-ec567300e477'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:42 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:42 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Acquiring lock "cinder-695d6650-16eb-4117-9c5a-df228c633914-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "cinder-695d6650-16eb-4117-9c5a-df228c633914-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Acquiring lock "cinder-quobyte-695d6650-16eb-4117-9c5a-df228c633914" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "cinder-quobyte-695d6650-16eb-4117-9c5a-df228c633914" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e974a4-2ac1-4046-a4ed-a86582d645e2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:42 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914
Jun 17 04:09:42 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:42 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.759s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.manager [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Deleted volume successfully.
Jun 17 04:09:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-a406218d-5d09-4377-851e-a3b29b64c15d req-63b3b53f-a4a4-487f-8efb-99962b7c1ff2 tempest-VolumesSnapshotsTestJSON-1036340950 None] Lock "cinder-f57c6d96-4283-40ab-9159-41de5b21d4c7-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:43 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914" returned: 0 in 0.818s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:43 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914
Jun 17 04:09:43 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:44 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-695d6650-16eb-4117-9c5a-df228c633914" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "cinder-quobyte-695d6650-16eb-4117-9c5a-df228c633914" released by "delete_volume" :: held 1.652s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-9aca847b-992b-4cbf-b179-fd43cb024fe5 req-086e5ed1-df9d-42bc-b59b-e94fb7907e50 tempest-AttachVolumeTestJSON-664675265 None] Terminate volume connection completed successfully.
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-9aca847b-992b-4cbf-b179-fd43cb024fe5 req-086e5ed1-df9d-42bc-b59b-e94fb7907e50 tempest-AttachVolumeTestJSON-664675265 None] Deleting attachment 96e9b1a1-112a-4eac-bc04-4d1c010b35e2. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Created reservations ['b15986e7-6011-490b-9fc9-a515e908b4c5', '8cfe21e8-2be0-42b5-9319-e2d8ef1fb45e', 'e7ac543e-de82-4e77-bbd0-e56a2ad77c7e', '4f82b0ce-ed15-4157-bf53-90dd138fa652'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:44 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:44 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:45 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.917s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff8d60-04c2-4996-b976-e45234a80c9a]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:45 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Deleted volume successfully.
Jun 17 04:09:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99fd361d-815c-4f94-81d6-20cfdb198aa6 tempest-AbsoluteLimitsTests-309971387 None] Lock "cinder-695d6650-16eb-4117-9c5a-df228c633914-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:45 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:45 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:46 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 0.958s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:46 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:09:46 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:47 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 1 in 1.007s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:09:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.056s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-d726ed2c-a166-474d-a1e7-36dae149b170', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca050538-2e34-43f7-a28c-20571bd9faf8', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:09:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-8b4f9091-c56e-42d8-b48d-f49cabc45bd1 req-f3205a0b-fba3-4787-bddc-813817fd4966 tempest-TestShelveInstance-765217980 None] attachment_update completed successfully.
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (6f234faa-2724-467d-b9f6-ce24b3e3f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557c427c-2540-4d58-86f8-8afc6e8b4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557c427c-2540-4d58-86f8-8afc6e8b4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533167490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352ebd27-6100-4335-a091-babf56fb17d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:48Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d13f4c-01ac-4de7-982e-76fa820129a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d13f4c-01ac-4de7-982e-76fa820129a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e37d0d6-74bd-41e9-a08e-6c081af1e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e37d0d6-74bd-41e9-a08e-6c081af1e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352ebd27-6100-4335-a091-babf56fb17d8', 'volume_name': 'volume-352ebd27-6100-4335-a091-babf56fb17d8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86190a4f-0bc3-4ca6-8ba9-de24253ef6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86190a4f-0bc3-4ca6-8ba9-de24253ef6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d91fb3c-4800-46ac-9744-4359d1e7db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:48 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Volume 352ebd27-6100-4335-a091-babf56fb17d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352ebd27-6100-4335-a091-babf56fb17d8', 'volume_size': 1}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533167490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352ebd27-6100-4335-a091-babf56fb17d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:48Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Creating volume 352ebd27-6100-4335-a091-babf56fb17d8 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:48 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:48 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 1073741824
Jun 17 04:09:48 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:49 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 1073741824" returned: 0 in 1.122s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:49 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8
Jun 17 04:09:49 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (e4c2de59-cdb1-4732-bbba-255f1649661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b4825-9975-4b78-8f68-ffabb73f19dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b4825-9975-4b78-8f68-ffabb73f19dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-269700069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f42b19c-745f-4963-bd10-7f9b658a4126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f47caac8f2f4f29960f3b241fc3c24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:50Z,use_quota=True,user_id='aef9f93b5fcb49db86607fc9f1a86610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8978947-14a4-4bf0-b36f-2d258fef61e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8978947-14a4-4bf0-b36f-2d258fef61e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bde0c42-eb00-4de0-9751-92113181b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bde0c42-eb00-4de0-9751-92113181b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f42b19c-745f-4963-bd10-7f9b658a4126', 'volume_name': 'volume-2f42b19c-745f-4963-bd10-7f9b658a4126', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2818db-dadd-46d0-8085-d341bfb5b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2818db-dadd-46d0-8085-d341bfb5b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c85320f-5a28-4f09-bc14-12cd8f224dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Volume 2f42b19c-745f-4963-bd10-7f9b658a4126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f42b19c-745f-4963-bd10-7f9b658a4126', 'volume_size': 1}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:50 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8" returned: 0 in 0.809s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-269700069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f42b19c-745f-4963-bd10-7f9b658a4126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f47caac8f2f4f29960f3b241fc3c24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:50Z,use_quota=True,user_id='aef9f93b5fcb49db86607fc9f1a86610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Creating volume 2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:50 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:50 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 1073741824
Jun 17 04:09:50 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d91fb3c-4800-46ac-9744-4359d1e7db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352ebd27-6100-4335-a091-babf56fb17d8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c846d8-c9a7-4b07-acf8-4863d74e6b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:50 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Volume volume-352ebd27-6100-4335-a091-babf56fb17d8 (352ebd27-6100-4335-a091-babf56fb17d8): created successfully
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c846d8-c9a7-4b07-acf8-4863d74e6b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (6f234faa-2724-467d-b9f6-ce24b3e3f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-36dde312-1889-4db0-88d9-4c022da41229 tempest-VolumesTestJSON-1242863674 None] Created volume successfully.
Jun 17 04:09:51 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 1073741824" returned: 0 in 0.747s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:51 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126
Jun 17 04:09:51 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:52 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126" returned: 0 in 0.624s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c85320f-5a28-4f09-bc14-12cd8f224dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f42b19c-745f-4963-bd10-7f9b658a4126', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff2203f-7ca2-4a0c-a552-f9bf2758dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Volume volume-2f42b19c-745f-4963-bd10-7f9b658a4126 (2f42b19c-745f-4963-bd10-7f9b658a4126): created successfully
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff2203f-7ca2-4a0c-a552-f9bf2758dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (e4c2de59-cdb1-4732-bbba-255f1649661d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-786b93cb-bab3-46e2-ab30-08f8eab3c2c2 tempest-VolumesDeleteCascade-2022679701 None] Created volume successfully.
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (d1927c58-8cb9-4f27-8450-86b5dac91e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3ea64-6647-42a9-bf76-5fdb76d4f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3ea64-6647-42a9-bf76-5fdb76d4f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1321216053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736609ae-2fbc-4581-87be-482af14477e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:52Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a48ebf8-b8c5-4f27-ac08-40dc6ac596f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a48ebf8-b8c5-4f27-ac08-40dc6ac596f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18209b0-171a-4636-b3d6-06ec7d75b818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18209b0-171a-4636-b3d6-06ec7d75b818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736609ae-2fbc-4581-87be-482af14477e5', 'volume_name': 'volume-736609ae-2fbc-4581-87be-482af14477e5', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03aa41ed-f138-4f6d-a849-fe47462ea967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03aa41ed-f138-4f6d-a849-fe47462ea967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899b71f5-2186-41b3-9b3e-00d2096ac2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:52 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Volume 736609ae-2fbc-4581-87be-482af14477e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736609ae-2fbc-4581-87be-482af14477e5', 'volume_size': 1}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1321216053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736609ae-2fbc-4581-87be-482af14477e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:52Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Creating volume 736609ae-2fbc-4581-87be-482af14477e5 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:09:52 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:52 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 1073741824
Jun 17 04:09:52 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:53 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 1073741824" returned: 0 in 1.257s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:53 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5
Jun 17 04:09:53 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:54 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5" returned: 0 in 0.651s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.342s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Creating offline snapshot e4ba6055-d089-4e98-8993-8ca522659989 of volume 2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899b71f5-2186-41b3-9b3e-00d2096ac2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736609ae-2fbc-4581-87be-482af14477e5', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b2ad20-b2cd-4127-8f06-2018a4e8e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b528e-ab91-4c39-a487-4104a1412f34]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:54 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Volume volume-736609ae-2fbc-4581-87be-482af14477e5 (736609ae-2fbc-4581-87be-482af14477e5): created successfully
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b2ad20-b2cd-4127-8f06-2018a4e8e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (d1927c58-8cb9-4f27-8450-86b5dac91e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-66d6a3c7-eeee-4446-810e-a84a61ec3691 tempest-VolumesTestJSON-1242863674 None] Created volume successfully.
Jun 17 04:09:54 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126
Jun 17 04:09:54 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:55 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (2ecf2095-12e3-48da-94d0-f0231fb48764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5a012-bd52-49ef-917f-a38af67a92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126" returned: 0 in 1.190s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5a012-bd52-49ef-917f-a38af67a92e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-488745675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:55Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd84c1-d4ce-4315-a6be-d3d425c70e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd84c1-d4ce-4315-a6be-d3d425c70e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a105c-7cf5-406c-9769-64b8d86ef2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a105c-7cf5-406c-9769-64b8d86ef2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4', 'volume_name': 'volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de2d15-012c-47d2-854d-f1dafe79eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de2d15-012c-47d2-854d-f1dafe79eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:09:55 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 1G
Jun 17 04:09:55 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9741a8-f4d9-48a2-835a-521591c9619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:09:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Volume 10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4', 'volume_size': 1}
Jun 17 04:09:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-quobyte-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[610388c0-ec5f-40f9-b308-958a8ab15441]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:56 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605
Jun 17 04:09:56 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:56 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 1G" returned: 0 in 1.184s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:56 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:09:56 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:57 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" returned: 0 in 0.922s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:57 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605
Jun 17 04:09:57 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:57 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 0.928s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:57 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 is being set with open permissions: ugo+rw
Jun 17 04:09:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:57 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:09:57 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:58 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605" released by "delete_volume" :: held 1.791s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Created reservations ['0167b49f-e2e8-42d1-bf1c-8088f5199798', 'fe286c17-b0ab-4dba-9df1-43db104a436b', '89fc3334-e377-4e6c-ab37-06c16782105e', 'ae17cb39-e2e4-4f99-a45a-e775c52a5f96'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:58 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:09:58 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-46132436-7200-454f-b3d2-3f938f8d1599-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-46132436-7200-454f-b3d2-3f938f8d1599-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-quobyte-46132436-7200-454f-b3d2-3f938f8d1599" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:09:58 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 1.009s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-46132436-7200-454f-b3d2-3f938f8d1599" acquired by "delete_volume" :: waited 0.055s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8702f382-6569-4c3e-bee7-d6c151e59ac0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:09:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:58 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info
Jun 17 04:09:58 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:58 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599
Jun 17 04:09:58 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:09:59 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.025s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:59 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:09:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Deleted volume successfully.
Jun 17 04:09:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6b08540b-40b6-4a2c-bd9c-b3132a20a85e tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-131d3b8d-1d89-4c38-a45f-2c6a0e3f2605-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:09:59 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Jun 17 04:09:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info" returned: 0 in 0.994s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:09:59 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info is being set with open permissions: ugo+rw
Jun 17 04:09:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:09:59 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info
Jun 17 04:09:59 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:00 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599" returned: 0 in 1.332s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:00 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599
Jun 17 04:10:00 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:00 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.info" returned: 0 in 0.726s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.173s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.853s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-488745675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68b4f1c3cb9049e18f4091ac2e8e3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:09:55Z,use_quota=True,user_id='2ea4a66dc6994ed8ae2aa6de40a1581a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Creating volume 10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:00 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:00 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 1073741824
Jun 17 04:10:00 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6dd1f37c-ab97-4182-b70e-5eb7eecabc4f tempest-VolumesDeleteCascade-2022679701 None] Create snapshot completed successfully
Jun 17 04:10:00 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-46132436-7200-454f-b3d2-3f938f8d1599" returned: 0 in 0.671s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-46132436-7200-454f-b3d2-3f938f8d1599" released by "delete_volume" :: held 2.088s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Created reservations ['e2347e8d-4231-42ee-93a9-798a132f25b0', 'bea31aab-1011-422f-8843-ff9b685fb46c', '4c07d663-8c58-4756-b13d-0b0e3dbfd1f8', 'bd511016-7482-4168-bef4-0b9624e6828a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:00 devstack sudo[101292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:00 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:01 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 1073741824" returned: 0 in 0.944s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:01 devstack sudo[101298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4
Jun 17 04:10:01 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:01 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.732s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Deleted volume successfully.
Jun 17 04:10:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-51f8dcda-af04-49b0-b3ab-3909b41a22b3 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-46132436-7200-454f-b3d2-3f938f8d1599-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-38943150-1a40-49b0-a2ca-a5a28d6ca12d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-38943150-1a40-49b0-a2ca-a5a28d6ca12d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "cinder-quobyte-38943150-1a40-49b0-a2ca-a5a28d6ca12d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-38943150-1a40-49b0-a2ca-a5a28d6ca12d" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:02 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1b6b0-b2fa-49a0-bf4b-0469748f0beb]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Creating offline snapshot 5617aa55-a7df-4b35-a80b-2f00b7c90611 of volume 2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:10:02 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:02 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9741a8-f4d9-48a2-835a-521591c9619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e98e91e-8710-4d3a-8f9c-5a9087ae509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27940e7-7cbc-4602-9356-a2531227a422]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:02 devstack sudo[101302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d
Jun 17 04:10:02 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:02 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Volume volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 (10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4): created successfully
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e98e91e-8710-4d3a-8f9c-5a9087ae509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Flow 'volume_create_manager' (2ecf2095-12e3-48da-94d0-f0231fb48764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-113d704c-e013-43ae-99d0-34d62abb5d5e tempest-VolumesTestJSON-1242863674 None] Created volume successfully.
Jun 17 04:10:02 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:10:02 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:02 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.665s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:10:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:10:03 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d" returned: 0 in 0.900s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:03 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d
Jun 17 04:10:03 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:03 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 1.034s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f42b19c-745f-4963-bd10-7f9b658a4126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:03 devstack sudo[101318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 1G
Jun 17 04:10:03 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:03 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-38943150-1a40-49b0-a2ca-a5a28d6ca12d" returned: 0 in 0.690s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-quobyte-38943150-1a40-49b0-a2ca-a5a28d6ca12d" released by "delete_volume" :: held 1.648s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Created reservations ['abb6f72a-1201-45dc-9cca-6b24a39c9c82', 'bbddd58a-866b-4e65-ad6a-38c5a810672d', '533d0f28-b790-49cd-ae08-c1e28b1df865', '45f42338-8180-4e0e-949f-062dd3be8b8a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:03 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:03 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-quobyte-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f0801-f172-49e1-80f4-d7883bc80f10]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:04 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 1G" returned: 0 in 1.077s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:04 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611
Jun 17 04:10:04 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:04 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4
Jun 17 04:10:04 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:04 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.976s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:04 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Deleted volume successfully.
Jun 17 04:10:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-830add69-e505-4057-8c8c-f886037c19c8 tempest-AttachVolumeTestJSON-664675265 None] Lock "cinder-38943150-1a40-49b0-a2ca-a5a28d6ca12d-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:05 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611" returned: 0 in 1.134s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:05 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 is being set with open permissions: ugo+rw
Jun 17 04:10:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:05 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611
Jun 17 04:10:05 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:05 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" returned: 0 in 1.210s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:05 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4
Jun 17 04:10:05 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:06 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=111,cinder:UPDATE=110,cinder:INSERT=41,cinder:DELETE=11 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=113,cinder:SELECT=108,cinder:INSERT=33,cinder:DELETE=9 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.038s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-47ce72cc-5d7f-48f3-b299-359991ced74d tempest-VolumesDeleteCascade-2022679701 None] Create snapshot completed successfully
Jun 17 04:10:06 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" returned: 0 in 0.805s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4" released by "delete_volume" :: held 2.060s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Created reservations ['a8085aec-5a2d-43cf-9c97-2c8a8c612e0a', '1f514f4e-a3c5-43c4-9659-9dfb87728c65', '7f5326a1-5f12-4465-aa0d-9390fd08dee7', '0648a1cd-4b29-4c69-b205-503263cb97c0'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:06 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:06 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-2f42b19c-745f-4963-bd10-7f9b658a4126-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-2f42b19c-745f-4963-bd10-7f9b658a4126-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Performing cascade delete. {{(pid=92204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-5617aa55-a7df-4b35-a80b-2f00b7c90611-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-5617aa55-a7df-4b35-a80b-2f00b7c90611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-5617aa55-a7df-4b35-a80b-2f00b7c90611" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-5617aa55-a7df-4b35-a80b-2f00b7c90611" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Deleting offline snapshot 5617aa55-a7df-4b35-a80b-2f00b7c90611 of volume 2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] snapshot_file for this snap is: volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fffbf-42ae-4c6e-bf39-9adf4d4eceeb]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:07 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.843s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:07 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611
Jun 17 04:10:07 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Deleted volume successfully.
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27adec98-9693-4710-a063-3de842ed4d22 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-10297be4-eb6a-415d-a3e6-eb3e0cb6b9f4-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-736609ae-2fbc-4581-87be-482af14477e5-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "cinder-736609ae-2fbc-4581-87be-482af14477e5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-quobyte-736609ae-2fbc-4581-87be-482af14477e5" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-736609ae-2fbc-4581-87be-482af14477e5" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ddc96-ff69-448e-a688-78f614461b30]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:08 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611" returned: 0 in 0.903s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f42b19c-745f-4963-bd10-7f9b658a4126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:08 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5
Jun 17 04:10:08 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[39078f59-0a82-4983-a0d8-a734dd45be0e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:08 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:10:08 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:08 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5" returned: 0 in 0.901s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:08 devstack sudo[101364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5
Jun 17 04:10:08 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:09 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 0.997s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f42b19c-745f-4963-bd10-7f9b658a4126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:09 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611
Jun 17 04:10:09 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:09 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-736609ae-2fbc-4581-87be-482af14477e5" returned: 0 in 0.800s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-736609ae-2fbc-4581-87be-482af14477e5" released by "delete_volume" :: held 1.846s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Created reservations ['80970697-af6d-4974-921e-e694fe895940', 'a15be3f9-4fe2-4cef-9767-d2c63a9207dc', 'a864684f-3958-4097-94a8-8564d350e133', '9f37837f-007b-493c-bac7-2f523d1f38bb'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:09 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:09 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-352ebd27-6100-4335-a091-babf56fb17d8-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-352ebd27-6100-4335-a091-babf56fb17d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "cinder-quobyte-352ebd27-6100-4335-a091-babf56fb17d8" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-352ebd27-6100-4335-a091-babf56fb17d8" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b11d3-98bc-4e74-bc11-8604f0f0bc83]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:10 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8
Jun 17 04:10:10 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:10 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611" returned: 0 in 1.144s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:10 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611
Jun 17 04:10:10 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:10 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.953s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Deleted volume successfully.
Jun 17 04:10:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab55c18f-bfaa-4c55-b5fa-08011f94de3a tempest-VolumesTestJSON-1242863674 None] Lock "cinder-736609ae-2fbc-4581-87be-482af14477e5-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:11 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:11 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8" returned: 0 in 0.956s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.5617aa55-a7df-4b35-a80b-2f00b7c90611" returned: 0 in 0.768s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:11 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8
Jun 17 04:10:11 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-5617aa55-a7df-4b35-a80b-2f00b7c90611" released by "_delete_snapshot" :: held 3.973s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" released by "delete_snapshot" :: held 4.002s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['e7d05b3a-1342-4b1f-90ef-98de753c4af9', 'ffc4c094-eb49-4b2c-9f92-d204c4275694', '09fb6f2d-7102-4b35-b8f0-77908398d9f4', '96fadb81-f730-4da9-9220-c23a1777f543'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Delete snapshot completed successfully.
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-5617aa55-a7df-4b35-a80b-2f00b7c90611-delete_snapshot" released by "delete_snapshot" :: held 4.169s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-e4ba6055-d089-4e98-8993-8ca522659989-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-e4ba6055-d089-4e98-8993-8ca522659989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-e4ba6055-d089-4e98-8993-8ca522659989" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-e4ba6055-d089-4e98-8993-8ca522659989" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Deleting offline snapshot e4ba6055-d089-4e98-8993-8ca522659989 of volume 2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] snapshot_file for this snap is: volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c3a09b-7e23-48ef-ab3b-c25ce0e474a7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:11 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:10:11 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:11 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-352ebd27-6100-4335-a091-babf56fb17d8" returned: 0 in 0.643s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-quobyte-352ebd27-6100-4335-a091-babf56fb17d8" released by "delete_volume" :: held 1.645s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Created reservations ['d80b2201-c571-4622-bf06-d1a5935fdbfc', '764a841a-3fc8-45b5-8e5a-37de30776adc', '52ab4c83-47c9-4c9a-9030-fe29074db0f3', '6bc809ea-b9d5-45c6-8d47-dc7839afe9d0'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:11 devstack sudo[101490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:11 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:12 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 0.741s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f42b19c-745f-4963-bd10-7f9b658a4126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01a5a4-3f8f-4283-8e0d-35332e11b948]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:12 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126
Jun 17 04:10:12 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:12 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.723s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Deleted volume successfully.
Jun 17 04:10:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12b15472-948b-46ba-bdd4-e72ba3d97e45 tempest-VolumesTestJSON-1242863674 None] Lock "cinder-352ebd27-6100-4335-a091-babf56fb17d8-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:13 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126" returned: 0 in 0.861s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:13 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:10:13 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:13 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 0.750s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:13 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989
Jun 17 04:10:13 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:14 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126.e4ba6055-d089-4e98-8993-8ca522659989" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-e4ba6055-d089-4e98-8993-8ca522659989" released by "_delete_snapshot" :: held 3.185s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" released by "delete_snapshot" :: held 3.213s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['8d52fec4-6936-4cb2-9fdc-3013344015ee', 'af535f6e-a4d3-4be5-a243-473963cc869c', 'c111be1c-979b-400b-a9ea-ff9e60654c7c', 'c1bb8153-59ad-4435-b626-088fb1069efb'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Delete snapshot completed successfully.
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-e4ba6055-d089-4e98-8993-8ca522659989-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Snapshots deleted, issuing volume delete {{(pid=92204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce0321b-39c9-4b50-a1b8-783e92a4f10b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:14 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126
Jun 17 04:10:14 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:15 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126" returned: 0 in 0.788s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:15 devstack sudo[101518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126
Jun 17 04:10:15 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:16 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2f42b19c-745f-4963-bd10-7f9b658a4126" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-2f42b19c-745f-4963-bd10-7f9b658a4126" released by "delete_volume" :: held 1.618s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['0a75965d-c779-4032-aa95-0eb8bc1dce8a', '15044f08-7a09-404d-84ba-03cc9e3b4720', '26bf7471-4a47-4dc6-af20-66f349658ebe', 'e230dfaa-eb3e-42b3-903b-18982fc6b895'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:16 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:16 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f879215f-7e49-4118-96bf-cb91e2466239 tempest-GroupSnapshotsV319Test-540319158 None] Group tempest-GroupSnapshotsV319Test-Group-446114232: creating
Jun 17 04:10:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f879215f-7e49-4118-96bf-cb91e2466239 tempest-GroupSnapshotsV319Test-540319158 None] Group tempest-GroupSnapshotsV319Test-Group-446114232: created successfully
Jun 17 04:10:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f879215f-7e49-4118-96bf-cb91e2466239 tempest-GroupSnapshotsV319Test-540319158 None] Create group completed successfully.
Jun 17 04:10:17 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.953s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Deleted volume successfully.
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7dbee84f-19d2-4818-b670-2a8784b9e239 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-2f42b19c-745f-4963-bd10-7f9b658a4126-delete_volume" released by "delete_volume" :: held 10.469s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (ec2250e7-8e3d-4ab9-b0ed-dbdcf9d3391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d087c75-e07a-44d6-bc75-06e7c1b66789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d087c75-e07a-44d6-bc75-06e7c1b66789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1087251893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c339ac2a-ed00-4da5-ba8e-d53d901e7bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f47caac8f2f4f29960f3b241fc3c24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:18Z,use_quota=True,user_id='aef9f93b5fcb49db86607fc9f1a86610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978c1cd9-f833-4e14-9d3f-864076229310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978c1cd9-f833-4e14-9d3f-864076229310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eea96e-e485-4271-8dc9-bf60e77e0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eea96e-e485-4271-8dc9-bf60e77e0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c339ac2a-ed00-4da5-ba8e-d53d901e7bda', 'volume_name': 'volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68768e4d-0a22-4095-894f-00a51802b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68768e4d-0a22-4095-894f-00a51802b15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d33308-b048-4259-89bf-6267c2a1d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Volume c339ac2a-ed00-4da5-ba8e-d53d901e7bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda', 'volume_size': 1}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1087251893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c339ac2a-ed00-4da5-ba8e-d53d901e7bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f47caac8f2f4f29960f3b241fc3c24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:18Z,use_quota=True,user_id='aef9f93b5fcb49db86607fc9f1a86610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Creating volume c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:18 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:18 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda 1073741824
Jun 17 04:10:18 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Flow 'volume_create_manager' (240d4794-886a-40bc-ac3c-e1a8035efc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1b3967-ac0a-4b46-9d40-dd1bd6925541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1b3967-ac0a-4b46-9d40-dd1bd6925541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369997949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=901588cd-710e-470d-bba2-6454800910f3,host='devstack@QuobyteHD#QuobyteHD',id=4954d9c6-2876-47d5-8eb0-275e8bcbf502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4badaccede994ff9a591d8ad0ad510a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:18Z,use_quota=True,user_id='c9331bc11c494b89b300691a183ce0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21e4a526-b568-4c98-8db1-ef02d1a02fdf),volume_type_id=21e4a526-b568-4c98-8db1-ef02d1a02fdf)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf9acb2-4d97-48df-8878-af23e25fe702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf9acb2-4d97-48df-8878-af23e25fe702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7516cd25-927f-4b95-9142-54ae37db8904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7516cd25-927f-4b95-9142-54ae37db8904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4954d9c6-2876-47d5-8eb0-275e8bcbf502', 'volume_name': 'volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb850b-cb4e-4233-b6ac-a6b4113d13bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb850b-cb4e-4233-b6ac-a6b4113d13bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d689a-ebff-46a2-aa76-4bb076738bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Volume 4954d9c6-2876-47d5-8eb0-275e8bcbf502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502', 'volume_size': 1}
Jun 17 04:10:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:19 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda 1073741824" returned: 0 in 1.311s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:19 devstack sudo[101530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:19 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:20 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.693s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=901588cd-710e-470d-bba2-6454800910f3,created_at=2026-06-17T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369997949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=901588cd-710e-470d-bba2-6454800910f3,host='devstack@QuobyteHD#QuobyteHD',id=4954d9c6-2876-47d5-8eb0-275e8bcbf502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4badaccede994ff9a591d8ad0ad510a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:18Z,use_quota=True,user_id='c9331bc11c494b89b300691a183ce0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21e4a526-b568-4c98-8db1-ef02d1a02fdf),volume_type_id=21e4a526-b568-4c98-8db1-ef02d1a02fdf)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Creating volume 4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:20 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d33308-b048-4259-89bf-6267c2a1d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d92a9c-5a9c-4558-bdb8-85de119f363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:20 devstack sudo[101539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 1073741824
Jun 17 04:10:20 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Volume volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda (c339ac2a-ed00-4da5-ba8e-d53d901e7bda): created successfully
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d92a9c-5a9c-4558-bdb8-85de119f363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (ec2250e7-8e3d-4ab9-b0ed-dbdcf9d3391e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fcd4c605-ecc6-44fd-b6bb-604d81b7a31f tempest-VolumesDeleteCascade-2022679701 None] Created volume successfully.
Jun 17 04:10:21 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 1073741824" returned: 0 in 1.111s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:21 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502
Jun 17 04:10:21 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:22 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502" returned: 0 in 0.871s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.666s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d689a-ebff-46a2-aa76-4bb076738bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b8a90-67ae-420f-9d5c-8613b2bec3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Creating offline snapshot 049447df-8c10-40cc-abc1-358420b9d73e of volume c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:10:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Volume volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 (4954d9c6-2876-47d5-8eb0-275e8bcbf502): created successfully
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b8a90-67ae-420f-9d5c-8613b2bec3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Flow 'volume_create_manager' (240d4794-886a-40bc-ac3c-e1a8035efc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf8e4e6-59de-488c-9c22-e558bd0cf84c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0076b3a3-43af-45f4-a766-95056f9738aa tempest-GroupSnapshotsV319Test-540319158 None] Created volume successfully.
Jun 17 04:10:22 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:22 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:23 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.828s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:23 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e 1G
Jun 17 04:10:23 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] GroupSnapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: creating.
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Group snapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: creating. {{(pid=92204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:23 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e 1G" returned: 0 in 0.861s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:24 devstack sudo[101598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:24 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:24 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:24 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e is being set with open permissions: ugo+rw
Jun 17 04:10:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:24 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:24 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:25 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 0.694s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:25 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info
Jun 17 04:10:25 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:26 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info" returned: 0 in 0.719s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:26 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info is being set with open permissions: ugo+rw
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:26 devstack sudo[101615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info
Jun 17 04:10:26 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-dd627320-26cb-4224-ace0-4c1f5b9f15f0 req-7b1aee78-d284-497f-9208-ff117ddd56f0 tempest-TestShelveInstance-765217980 None] Terminate volume connection completed successfully.
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-dd627320-26cb-4224-ace0-4c1f5b9f15f0 req-7b1aee78-d284-497f-9208-ff117ddd56f0 tempest-TestShelveInstance-765217980 None] Deleting attachment ca050538-2e34-43f7-a28c-20571bd9faf8. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:10:26 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.info" returned: 0 in 0.666s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.571s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Creating offline snapshot 4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 of volume 4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:10:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7cc87e8d-adb5-4721-9465-3957bf9e5073 tempest-VolumesDeleteCascade-2022679701 None] Create snapshot completed successfully
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e776b8-baef-4a6f-a679-2c602f760485]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:27 devstack sudo[101619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502
Jun 17 04:10:27 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:27 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502" returned: 0 in 0.838s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:27 devstack sudo[101626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 1G
Jun 17 04:10:27 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (c04d4bb5-6c08-40ae-9878-08548cba2a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08824e9-608c-458b-a253-121ea137bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08824e9-608c-458b-a253-121ea137bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-524005395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0b3299-4a28-4e4b-9059-8933cf223482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f47caac8f2f4f29960f3b241fc3c24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=049447df-8c10-40cc-abc1-358420b9d73e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:28Z,use_quota=True,user_id='aef9f93b5fcb49db86607fc9f1a86610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd1e4c5-34b0-4f57-83cf-97338586372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd1e4c5-34b0-4f57-83cf-97338586372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c1010c-7e36-4ce8-b289-7e7946127429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c1010c-7e36-4ce8-b289-7e7946127429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a0b3299-4a28-4e4b-9059-8933cf223482', 'volume_name': 'volume-6a0b3299-4a28-4e4b-9059-8933cf223482', 'volume_size': 1, 'snapshot_id': '049447df-8c10-40cc-abc1-358420b9d73e'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828123e2-0ee1-4acf-bd0c-9bebff068d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828123e2-0ee1-4acf-bd0c-9bebff068d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766c3bbd-a8af-4f5c-9d02-ee0c6f7ad404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Volume 6a0b3299-4a28-4e4b-9059-8933cf223482: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a0b3299-4a28-4e4b-9059-8933cf223482', 'volume_size': 1, 'snapshot_id': '049447df-8c10-40cc-abc1-358420b9d73e'}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:28 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 1G" returned: 0 in 0.952s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:28 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6
Jun 17 04:10:28 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:29 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" returned: 0 in 0.625s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:29 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:10:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:29 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6
Jun 17 04:10:29 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:29 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" returned: 0 in 0.595s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:29 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info
Jun 17 04:10:29 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:30 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info" returned: 0 in 0.611s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:30 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:10:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:30 devstack sudo[101645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info
Jun 17 04:10:30 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:31 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.info" returned: 0 in 0.680s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.727s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e-6a0b3299-4a28-4e4b-9059-8933cf223482" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e-6a0b3299-4a28-4e4b-9059-8933cf223482" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Creating volume 6a0b3299-4a28-4e4b-9059-8933cf223482 from snapshot 049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] snapshot: 049447df-8c10-40cc-abc1-358420b9d73e, volume: 6a0b3299-4a28-4e4b-9059-8933cf223482,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9248cbe-a772-430b-97cf-112213614ab0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e311a387-db4f-4bf5-9e54-890aa6ecc305 tempest-GroupSnapshotsV319Test-540319158 None] group_snapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: created successfully
Jun 17 04:10:31 devstack sudo[101648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:31 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] group_snapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: deleting
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] group_snapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: deleting {{(pid=92204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" acquired by "delete_snapshot" :: waited 0.047s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "cinder-quobyte-4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Deleting offline snapshot 4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 of volume 4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] snapshot_file for this snap is: volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:10:32 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 0.991s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c7a97-9e24-414d-ad5d-7f503c1c3147]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a59907b-639f-42bf-881f-7e01a4e06ce0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:32 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:32 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:32 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6
Jun 17 04:10:32 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:33 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.780s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:33 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482
Jun 17 04:10:33 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:33 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" returned: 0 in 0.908s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a1cd1-1f13-49d6-9cd8-eec3938d688b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:33 devstack sudo[101692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502
Jun 17 04:10:33 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:34 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502" returned: 0 in 0.937s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:34 devstack sudo[101715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6
Jun 17 04:10:34 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:35 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" returned: 0 in 1.554s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:35 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6
Jun 17 04:10:35 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:37 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502.4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" returned: 0 in 1.480s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4cfbddc0-7db5-475f-9fe2-3ecbb7dc91a6" released by "_delete_snapshot" :: held 5.067s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" released by "delete_snapshot" :: held 5.152s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:37 devstack cinder-volume[92204]: WARNING cinder.quota [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-768290121 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-768290121, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:10:37 devstack cinder-volume[92204]: WARNING cinder.quota [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-768290121 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-768290121, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:10:37 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] Created reservations ['981e9a1b-ce76-48b5-a743-e55bb302e1c8', '4a8cc512-b959-46ad-b2a4-e67fd13c6b32', '4d82a7e2-04b6-4578-9a2b-2a0b2f505e03', '43dcfa4f-c70a-4a0b-a618-f3dfb21826b8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6ad4cfd8-dff5-496f-b917-0681ba151cb8 tempest-GroupSnapshotsV319Test-540319158 None] group_snapshot d5c1e040-32c6-47e3-8221-9492d9fc498d: deleted successfully
Jun 17 04:10:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" acquired by "delete_volume" :: waited 0.059s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effce4c-d35a-4bb6-8748-aae4e35eb21d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:39 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502
Jun 17 04:10:39 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:39 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482" returned: 0 in 6.089s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:39 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22e9c97-01af-4f26-a26d-8bf4097cd4ec]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:39 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:39 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:40 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502" returned: 0 in 1.408s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:40 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502
Jun 17 04:10:40 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:40 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 1.083s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:10:40 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Converted 1024.00 MB image at 168.13 MB/s
Jun 17 04:10:40 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 is being set with open permissions: ugo+rw
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:40 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482
Jun 17 04:10:40 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:40 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4954d9c6-2876-47d5-8eb0-275e8bcbf502" returned: 0 in 0.831s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Lock "cinder-quobyte-4954d9c6-2876-47d5-8eb0-275e8bcbf502" released by "delete_volume" :: held 2.479s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Created reservations ['09663fb6-eb61-4ffe-85b5-a7a4c597a3a7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:41 devstack cinder-volume[92204]: WARNING cinder.quota [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-768290121 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-768290121, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Created reservations ['ef1fe859-9653-4760-81c8-2b48be2e9ea8', 'aed7487f-0442-4486-8fa4-30771d394e4e', '21f5df42-3ebb-49f9-a395-b30f9e03c81a', '2e5c630f-ce55-4d10-be2e-3857da2fb9b4'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:41 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482" returned: 0 in 0.762s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" released by "_copy_volume_from_snapshot" :: held 9.863s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e-6a0b3299-4a28-4e4b-9059-8933cf223482" released by "_create_volume_from_snapshot" :: held 9.915s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.938s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.527s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766c3bbd-a8af-4f5c-9d02-ee0c6f7ad404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0b3299-4a28-4e4b-9059-8933cf223482', 'volume_size': 1, 'snapshot_id': '049447df-8c10-40cc-abc1-358420b9d73e'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ca1da3-473a-4835-bc04-1b7a556e07fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63397f4-9aee-47f2-94f6-158402c1d89c]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:41 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Volume volume-6a0b3299-4a28-4e4b-9059-8933cf223482 (6a0b3299-4a28-4e4b-9059-8933cf223482): created successfully
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ca1da3-473a-4835-bc04-1b7a556e07fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Flow 'volume_create_manager' (c04d4bb5-6c08-40ae-9878-08548cba2a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-db324c36-237b-4404-8ac5-ad9c74fc770f tempest-VolumesDeleteCascade-2022679701 None] Created volume successfully.
Jun 17 04:10:41 devstack sudo[101811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:41 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:41 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:10:41 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:42 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.935s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-62ca09ea-95ab-4887-99a1-03480b2bb417 tempest-GroupSnapshotsV319Test-540319158 None] Delete group completed successfully.
Jun 17 04:10:42 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 1.009s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:42 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:10:42 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-c339ac2a-ed00-4da5-ba8e-d53d901e7bda-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-c339ac2a-ed00-4da5-ba8e-d53d901e7bda-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Performing cascade delete. {{(pid=92204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-049447df-8c10-40cc-abc1-358420b9d73e-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-049447df-8c10-40cc-abc1-358420b9d73e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Deleting offline snapshot 049447df-8c10-40cc-abc1-358420b9d73e of volume c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] snapshot_file for this snap is: volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733d792-d7a7-40ac-a2b4-dd42d1f85eb6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:43 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:43 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:43 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 1 in 1.312s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:10:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.383s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-d726ed2c-a166-474d-a1e7-36dae149b170', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f68e9f8e-8ec3-44c2-a9f4-6f4f36801b6c', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:10:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-dfb17f4a-39d5-42bf-b4ae-93df2c3e4987 req-8e084e2d-5b71-4575-9264-50330f8cea26 tempest-TestShelveInstance-765217980 None] attachment_update completed successfully.
Jun 17 04:10:44 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 1.065s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:10:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519ad53-1f17-4edf-bbaf-bd1bb5343509]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:44 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:44 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:45 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.985s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:45 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:45 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:45 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 0.922s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:45 devstack sudo[101878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e
Jun 17 04:10:45 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:46 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda.049447df-8c10-40cc-abc1-358420b9d73e" returned: 0 in 0.776s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-049447df-8c10-40cc-abc1-358420b9d73e" released by "_delete_snapshot" :: held 3.884s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" released by "delete_snapshot" :: held 3.915s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['6dbc9307-0502-472e-9512-f232d059d53c', 'd9972743-e406-4f1a-adc0-d0f930d5acc5', '402e7e58-3f28-48c1-bbf3-a2521eac1023', '93e3c4c9-66d3-46e5-8061-7a8295abb2d8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Delete snapshot completed successfully.
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-049447df-8c10-40cc-abc1-358420b9d73e-delete_snapshot" released by "delete_snapshot" :: held 4.177s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Snapshots deleted, issuing volume delete {{(pid=92204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 17 04:10:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee67520-64eb-4430-b669-27169788d0ac]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:47 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:47 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:47 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.816s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:47 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda
Jun 17 04:10:47 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:48 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" returned: 0 in 0.688s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-c339ac2a-ed00-4da5-ba8e-d53d901e7bda" released by "delete_volume" :: held 1.583s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['64e6115f-7fa4-4e12-be04-60bcb003776c', '5d4c5ca3-edeb-4b39-a0b7-f5d81c2d718f', 'b891cfb8-6d2a-4bf4-b40c-bb80ba71f52c', '0051669e-ebb3-450c-93d7-4d4c574a2373'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:48 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:48 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-6a0b3299-4a28-4e4b-9059-8933cf223482-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-6a0b3299-4a28-4e4b-9059-8933cf223482-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84676b2-85c4-4990-b194-18ac61be80c6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:49 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482
Jun 17 04:10:49 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:49 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.080s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Deleted volume successfully.
Jun 17 04:10:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d458b899-c076-41c1-86a8-7763797ae87c tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-c339ac2a-ed00-4da5-ba8e-d53d901e7bda-delete_volume" released by "delete_volume" :: held 7.227s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:50 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482" returned: 0 in 1.055s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:50 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482
Jun 17 04:10:50 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:51 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6a0b3299-4a28-4e4b-9059-8933cf223482" returned: 0 in 0.789s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-quobyte-6a0b3299-4a28-4e4b-9059-8933cf223482" released by "delete_volume" :: held 1.908s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Created reservations ['29adcdf1-fc55-4e48-84dd-847fe1462874', 'fa68870d-da15-4089-9927-b6939830636d', 'bc7ea938-1787-4440-bf24-2e8a3bc867e4', 'daa893ba-1b7d-43ce-83f7-d859055d04fd'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:51 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:10:51 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:52 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.115s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:52 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:10:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Deleted volume successfully.
Jun 17 04:10:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-908b740f-6e9a-4627-8621-4ed6ebdcad08 tempest-VolumesDeleteCascade-2022679701 None] Lock "cinder-6a0b3299-4a28-4e4b-9059-8933cf223482-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:10:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b7a8a6f2-c9ea-439c-be7b-79e684d1b853 tempest-GroupsV314Test-1827394061 None] Group tempest-GroupsV314Test-Group-1605921712: creating
Jun 17 04:10:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b7a8a6f2-c9ea-439c-be7b-79e684d1b853 tempest-GroupsV314Test-1827394061 None] Group tempest-GroupsV314Test-Group-1605921712: created successfully
Jun 17 04:10:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b7a8a6f2-c9ea-439c-be7b-79e684d1b853 tempest-GroupsV314Test-1827394061 None] Create group completed successfully.
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Flow 'volume_create_manager' (9700fef7-dd53-4c11-97a4-4405e22e6030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274d5134-4bc8-49f7-83f7-c91a9632cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274d5134-4bc8-49f7-83f7-c91a9632cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951858747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86717d8b-f73d-4748-aeac-6375fb58ef94,host='devstack@QuobyteHD#QuobyteHD',id=86eb17cf-152d-4de7-9812-fc4af5ff9dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe35c2702f40c78c1bf850e86897ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:57Z,use_quota=True,user_id='d88f77a26c784ddc90b7ee927b5fc2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(521b0110-21b7-46d4-bd99-616312d5608c),volume_type_id=521b0110-21b7-46d4-bd99-616312d5608c)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb02feb5-043d-4582-9e18-8db0f287204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb02feb5-043d-4582-9e18-8db0f287204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77229d93-47b0-4400-8d9b-2a25bbdc4485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77229d93-47b0-4400-8d9b-2a25bbdc4485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86eb17cf-152d-4de7-9812-fc4af5ff9dcd', 'volume_name': 'volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272346a0-cb94-45b9-b8b0-8e853f478a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272346a0-cb94-45b9-b8b0-8e853f478a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7151afc6-6bc0-40df-b28b-2d20c60cc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Volume 86eb17cf-152d-4de7-9812-fc4af5ff9dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd', 'volume_size': 1}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=86717d8b-f73d-4748-aeac-6375fb58ef94,created_at=2026-06-17T02:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951858747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86717d8b-f73d-4748-aeac-6375fb58ef94,host='devstack@QuobyteHD#QuobyteHD',id=86eb17cf-152d-4de7-9812-fc4af5ff9dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe35c2702f40c78c1bf850e86897ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:57Z,use_quota=True,user_id='d88f77a26c784ddc90b7ee927b5fc2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(521b0110-21b7-46d4-bd99-616312d5608c),volume_type_id=521b0110-21b7-46d4-bd99-616312d5608c)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Creating volume 86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:57 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd 1073741824
Jun 17 04:10:57 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Flow 'volume_create_manager' (0d591ef8-7009-4a6b-9659-ca6c9810f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6688725c-dc9c-41fd-8f03-d1b09044e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6688725c-dc9c-41fd-8f03-d1b09044e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-406154444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f8d141-44c1-4fad-9382-332100647702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50b77eade347aaa499c82527fc3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:58Z,use_quota=True,user_id='fdbd237f48474f4f9235e955a2b6e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41931b1c-d48f-40c7-9fb9-73c9d596ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41931b1c-d48f-40c7-9fb9-73c9d596ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec31999-0ec3-4084-9ba8-1b1ab267a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec31999-0ec3-4084-9ba8-1b1ab267a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f8d141-44c1-4fad-9382-332100647702', 'volume_name': 'volume-57f8d141-44c1-4fad-9382-332100647702', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51ecd0-5dc6-499c-ad30-0353a759795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51ecd0-5dc6-499c-ad30-0353a759795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af20e4a-7b58-4f50-83ee-b9beac01ca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Volume 57f8d141-44c1-4fad-9382-332100647702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f8d141-44c1-4fad-9382-332100647702', 'volume_size': 1}
Jun 17 04:10:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:58 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd 1073741824" returned: 0 in 0.879s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:58 devstack sudo[102387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:10:58 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:59 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-406154444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f8d141-44c1-4fad-9382-332100647702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50b77eade347aaa499c82527fc3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:10:58Z,use_quota=True,user_id='fdbd237f48474f4f9235e955a2b6e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Creating volume 57f8d141-44c1-4fad-9382-332100647702 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:10:59 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7151afc6-6bc0-40df-b28b-2d20c60cc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:59 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 1073741824
Jun 17 04:10:59 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f7049-ec4d-4574-a780-ab11505627e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:10:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Volume volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd (86eb17cf-152d-4de7-9812-fc4af5ff9dcd): created successfully
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f7049-ec4d-4574-a780-ab11505627e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:10:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Flow 'volume_create_manager' (9700fef7-dd53-4c11-97a4-4405e22e6030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:10:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d885d758-2c94-4099-9712-e48530e33577 tempest-GroupsV314Test-1827394061 None] Created volume successfully.
Jun 17 04:11:00 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 1073741824" returned: 0 in 0.948s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:00 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702
Jun 17 04:11:00 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:00 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702" returned: 0 in 0.780s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:11:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.049s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:01 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Cloning volume 86eb17cf-152d-4de7-9812-fc4af5ff9dcd to volume 48a6c962-c93c-4067-99eb-9dfdfbda4b9e
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af20e4a-7b58-4f50-83ee-b9beac01ca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f8d141-44c1-4fad-9382-332100647702', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7f69e1-e38d-47f1-a2b8-23ecd7f453cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:01 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Volume volume-57f8d141-44c1-4fad-9382-332100647702 (57f8d141-44c1-4fad-9382-332100647702): created successfully
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7f69e1-e38d-47f1-a2b8-23ecd7f453cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Flow 'volume_create_manager' (0d591ef8-7009-4a6b-9659-ca6c9810f211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Creating offline snapshot 4ea07db2-b881-4ab8-84ab-6ca560dd9625 of volume 86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec484e-0fbc-4c8b-ba68-17e6fa772958]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-67cb95c2-0a34-4044-b75a-e6137710387d tempest-VolumesTransfersV357Test-1537948430 None] Created volume successfully.
Jun 17 04:11:01 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:01 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:01 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.821s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:01 devstack sudo[102405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 1G
Jun 17 04:11:01 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:02 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:02 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-17371a00-3677-4657-bc37-3ef7f3ba1610 tempest-VolumesTransfersV357Test-747539302 None] Transfer volume completed successfully.
Jun 17 04:11:02 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 1G" returned: 0 in 0.945s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:02 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:02 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:02 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:11:03 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:03 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:03 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:03 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "cinder-57f8d141-44c1-4fad-9382-332100647702-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-57f8d141-44c1-4fad-9382-332100647702-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "cinder-quobyte-57f8d141-44c1-4fad-9382-332100647702" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-quobyte-57f8d141-44c1-4fad-9382-332100647702" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de87b5-72ea-4b71-b36f-b1bc00294130]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:04 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702
Jun 17 04:11:04 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:04 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.739s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:04 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info
Jun 17 04:11:04 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (705f780c-7367-461f-8816-c41086e231d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6627fe-7a2e-4679-a293-c63f387b9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6627fe-7a2e-4679-a293-c63f387b9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193842609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d91f335-660b-466b-a383-5657575c5863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:05Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daff62f9-3b58-498c-88f8-c7675073b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daff62f9-3b58-498c-88f8-c7675073b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6101775-17c1-4f04-8617-19d95d4abef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6101775-17c1-4f04-8617-19d95d4abef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d91f335-660b-466b-a383-5657575c5863', 'volume_name': 'volume-8d91f335-660b-466b-a383-5657575c5863', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a54c94a-ea6e-4e74-873a-94dfd5af480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a54c94a-ea6e-4e74-873a-94dfd5af480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6904462f-65db-4491-8958-36c9a878a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Volume 8d91f335-660b-466b-a383-5657575c5863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d91f335-660b-466b-a383-5657575c5863', 'volume_size': 1}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:04 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702" returned: 0 in 0.936s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:04 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702
Jun 17 04:11:04 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:05 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info" returned: 0 in 0.781s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:05 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:05 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info
Jun 17 04:11:05 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:05 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57f8d141-44c1-4fad-9382-332100647702" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-quobyte-57f8d141-44c1-4fad-9382-332100647702" released by "delete_volume" :: held 1.614s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Created reservations ['db32a225-233d-45f7-bb64-a087195e5da7', '2e9b26d9-04fc-4480-9c8b-08e4f7f177ac', 'c90c96ad-be71-48d5-ac2f-2e562657e0d6', 'db169a50-9684-4657-bcf9-fd57da74698c'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:05 devstack sudo[102439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:05 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:05 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.info" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Acquiring lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] snapshot: 4ea07db2-b881-4ab8-84ab-6ca560dd9625, volume: 48a6c962-c93c-4067-99eb-9dfdfbda4b9e,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa572c-d0f2-4259-8810-fb88aeeb0fca]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:06 devstack sudo[102442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:06 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:06 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.741s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Deleted volume successfully.
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=104,cinder:DELETE=8 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e02eefb2-0cae-4351-9dba-feac38e2670c tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-57f8d141-44c1-4fad-9382-332100647702-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=95,cinder:UPDATE=119,cinder:DELETE=6,cinder:INSERT=26 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Flow 'volume_create_manager' (aa03f108-b51a-4a43-b4b4-8599ecf66985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e8d7e7-0809-4bdd-a06e-ab32a7f2b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e8d7e7-0809-4bdd-a06e-ab32a7f2b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1711908294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ea2e2-f1f3-49b4-8663-84242a761a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50b77eade347aaa499c82527fc3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:07Z,use_quota=True,user_id='fdbd237f48474f4f9235e955a2b6e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28997e24-3532-45f4-b244-0ee7c5a68b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28997e24-3532-45f4-b244-0ee7c5a68b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd7780-01ec-4ecf-a281-be1abc2913db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd7780-01ec-4ecf-a281-be1abc2913db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91ea2e2-f1f3-49b4-8663-84242a761a34', 'volume_name': 'volume-e91ea2e2-f1f3-49b4-8663-84242a761a34', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e15f9-5e42-4a0a-af18-e595ed4f1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e15f9-5e42-4a0a-af18-e595ed4f1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc72ec1-9062-459f-bfcc-e19f1d8500d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:06 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Volume e91ea2e2-f1f3-49b4-8663-84242a761a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91ea2e2-f1f3-49b4-8663-84242a761a34', 'volume_size': 1}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:06 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.889s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a156bf7d-adc3-451f-862d-a3c6fdd4c553]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:06 devstack sudo[102448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:06 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:07 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.700s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:07 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:11:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:07 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e
Jun 17 04:11:07 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:13 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" returned: 0 in 5.834s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:13 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b8eca-0f8f-4601-aa99-9f33afde4182]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:13 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:13 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:14 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.850s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:11:14 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Converted 1024.00 MB image at 175.49 MB/s
Jun 17 04:11:14 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e is being set with open permissions: ugo+rw: NotImplementedError
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:14 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e
Jun 17 04:11:14 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:14 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" returned: 0 in 0.569s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" released by "_copy_volume_from_snapshot" :: held 8.925s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Acquiring lock "cinder-quobyte-4ea07db2-b881-4ab8-84ab-6ca560dd9625" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-4ea07db2-b881-4ab8-84ab-6ca560dd9625" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Deleting offline snapshot 4ea07db2-b881-4ab8-84ab-6ca560dd9625 of volume 86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] snapshot_file for this snap is: volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7b00a7-8daf-42d2-b826-67642cf2d627]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:15 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:15 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:15 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.715s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:11:15 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1482224-4eec-454f-9df0-44369abdf853]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:15 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:15 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:16 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.697s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:16 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:16 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:17 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.657s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:17 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625
Jun 17 04:11:17 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:17 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd.4ea07db2-b881-4ab8-84ab-6ca560dd9625" returned: 0 in 0.597s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-4ea07db2-b881-4ab8-84ab-6ca560dd9625" released by "_delete_snapshot" :: held 2.745s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.647s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.812s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193842609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d91f335-660b-466b-a383-5657575c5863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:05Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Creating volume 8d91f335-660b-466b-a383-5657575c5863 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:11:17 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:11:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:17 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 1073741824
Jun 17 04:11:17 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-25749b75-fe15-4d62-8800-1cc07533fbf3 tempest-GroupsV314Test-1827394061 None] Create group from source-group-86717d8b-f73d-4748-aeac-6375fb58ef94 completed successfully.
Jun 17 04:11:18 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 1073741824" returned: 0 in 0.802s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:18 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863
Jun 17 04:11:18 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Acquiring lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e61a28-3304-463c-a9ca-26dd564207a7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:18 devstack sudo[102537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e
Jun 17 04:11:18 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:19 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863" returned: 0 in 0.592s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.443s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1711908294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ea2e2-f1f3-49b4-8663-84242a761a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50b77eade347aaa499c82527fc3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:07Z,use_quota=True,user_id='fdbd237f48474f4f9235e955a2b6e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Creating volume e91ea2e2-f1f3-49b4-8663-84242a761a34 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:11:19 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6904462f-65db-4491-8958-36c9a878a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d91f335-660b-466b-a383-5657575c5863', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:19 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 1073741824
Jun 17 04:11:19 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67404ea4-21ee-4f25-b35b-70558115f980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Volume volume-8d91f335-660b-466b-a383-5657575c5863 (8d91f335-660b-466b-a383-5657575c5863): created successfully
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67404ea4-21ee-4f25-b35b-70558115f980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (705f780c-7367-461f-8816-c41086e231d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fe811f71-f3f3-4a4c-aa3f-aeeda023250a tempest-AttachVolumeNegativeTest-2076455395 None] Created volume successfully.
Jun 17 04:11:19 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" returned: 0 in 0.772s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:19 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e
Jun 17 04:11:19 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:19 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 1073741824" returned: 0 in 0.819s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:19 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34
Jun 17 04:11:19 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:20 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" returned: 0 in 0.726s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-48a6c962-c93c-4067-99eb-9dfdfbda4b9e" released by "delete_volume" :: held 1.558s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Created reservations ['6d79e1f2-babf-4feb-84b3-73dc2f8a22e7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:20 devstack cinder-volume[92204]: WARNING cinder.quota [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1791873299 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1791873299, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:11:20 devstack cinder-volume[92204]: WARNING cinder.quota [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1791873299 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1791873299, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Created reservations ['5a0c5716-e55f-4953-91af-de0529ed6b09', 'd1b1bb79-ade1-4808-9c1e-f822d86e18e2', '3641cbd2-70fb-4e97-9391-72e2a4803019', '821ee99f-bdb9-49d9-90be-26c7a808be88'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:20 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:20 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:20 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34" returned: 0 in 0.723s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc72ec1-9062-459f-bfcc-e19f1d8500d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91ea2e2-f1f3-49b4-8663-84242a761a34', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b08e0f-47f7-48d2-b220-794034fbe1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Volume volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 (e91ea2e2-f1f3-49b4-8663-84242a761a34): created successfully
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b08e0f-47f7-48d2-b220-794034fbe1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Flow 'volume_create_manager' (aa03f108-b51a-4a43-b4b4-8599ecf66985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b95dd766-7180-45c5-a611-a3386faed5ba tempest-VolumesTransfersV357Test-1537948430 None] Created volume successfully.
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Acquiring lock "cinder-quobyte-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ea5cf-9503-4d42-8514-dd0d5f5895c0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:21 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.718s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:21 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0472b159-0c89-46e6-b11c-2c3a290f51ac tempest-GroupsV314Test-1827394061 None] Delete group completed successfully.
Jun 17 04:11:21 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:21 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "cinder-e91ea2e2-f1f3-49b4-8663-84242a761a34-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-e91ea2e2-f1f3-49b4-8663-84242a761a34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "cinder-quobyte-e91ea2e2-f1f3-49b4-8663-84242a761a34" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-quobyte-e91ea2e2-f1f3-49b4-8663-84242a761a34" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726e687-ca20-40d3-ac60-6cabeeb703d9]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:21 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34
Jun 17 04:11:21 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:22 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.841s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:22 devstack sudo[102573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd
Jun 17 04:11:22 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:22 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34" returned: 0 in 0.763s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:22 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34
Jun 17 04:11:22 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:22 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" returned: 0 in 0.608s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Lock "cinder-quobyte-86eb17cf-152d-4de7-9812-fc4af5ff9dcd" released by "delete_volume" :: held 1.537s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Created reservations ['705b74e4-deda-47a4-8029-76fb9f69580b'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Created reservations ['7580830d-a42e-4fee-afc8-50dbe2a8dfb1', 'bfea0ae8-72ce-44cf-9e76-dcda36ebe7d2', '2787938e-a416-4a60-98b1-d453692040f7', '5afd50b6-a22c-4a23-bd1b-552bf0b0ea52'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:23 devstack sudo[102582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:23 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:23 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e91ea2e2-f1f3-49b4-8663-84242a761a34" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-quobyte-e91ea2e2-f1f3-49b4-8663-84242a761a34" released by "delete_volume" :: held 1.449s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Created reservations ['2ecfa617-a53a-4879-ba9c-c2225e42e0ff', '2e76a97c-b0ac-4631-8603-61ea2cc5316f', 'f818c708-7631-4d3a-9cbc-b34e67bb2c27', '3cd5ac08-9ef8-4c10-a1a3-6d4f57eeee8e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:23 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:23 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc52d5-415f-44ba-aa43-fdcda01820cc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:23 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863
Jun 17 04:11:23 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:23 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.699s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:23 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-42176f58-7659-4f57-bc35-cedf56906d91 tempest-GroupsV314Test-1827394061 None] Delete group completed successfully.
Jun 17 04:11:24 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.799s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Deleted volume successfully.
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b36bc94-d967-4792-bb50-33f360929c80 tempest-VolumesTransfersV357Test-2031532714 None] Lock "cinder-e91ea2e2-f1f3-49b4-8663-84242a761a34-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:24 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863" returned: 0 in 0.929s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-8d91f335-660b-466b-a383-5657575c5863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5758aa19-952e-479f-9e98-b2fab72a1f1e', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:11:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-7a3f98d3-f1d7-4c40-a3aa-cb8d8136a416 req-f90f5734-26e5-42c1-a4b8-477d0172b25c tempest-AttachVolumeNegativeTest-2076455395 None] attachment_update completed successfully.
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Flow 'volume_create_manager' (d9c0d100-a3db-4eed-a7e4-2608c3a53542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a516d4d-654e-4215-8f1c-03cfbe54b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a516d4d-654e-4215-8f1c-03cfbe54b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1966876366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a312e441-5ebf-4ab3-99b3-4244170d5023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cffdaddb9543e29d71a585c2adb939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:29Z,use_quota=True,user_id='0dd3e6f9e31b4dd09b028ec8dcb9767d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4f3518-dd36-4206-a663-34959539d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4f3518-dd36-4206-a663-34959539d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66d0ed-8b29-40e2-9c43-9af46a7ec34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66d0ed-8b29-40e2-9c43-9af46a7ec34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a312e441-5ebf-4ab3-99b3-4244170d5023', 'volume_name': 'volume-a312e441-5ebf-4ab3-99b3-4244170d5023', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8bdcad-0219-4fda-8652-d06fbd403eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8bdcad-0219-4fda-8652-d06fbd403eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bcaa87-ab86-48f7-8052-93ebedf97072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Volume a312e441-5ebf-4ab3-99b3-4244170d5023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a312e441-5ebf-4ab3-99b3-4244170d5023', 'volume_size': 1}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1966876366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a312e441-5ebf-4ab3-99b3-4244170d5023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cffdaddb9543e29d71a585c2adb939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:29Z,use_quota=True,user_id='0dd3e6f9e31b4dd09b028ec8dcb9767d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Creating volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:11:29 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:29 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 1073741824
Jun 17 04:11:29 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Flow 'volume_create_manager' (d345be8b-2d08-4f19-b2c2-80a03792bd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a282ff1-5a89-4cb8-b600-177d928553c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a282ff1-5a89-4cb8-b600-177d928553c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1710807853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1011cf-7234-4047-8ffa-e0b3d069f1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1feaff407a2f468dbb41ec1a36b8b3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:30Z,use_quota=True,user_id='a6fb711aeb3d4fbca014a19d4f7b193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9efd35-4c3b-4b2f-9080-4766939d6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9efd35-4c3b-4b2f-9080-4766939d6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ac5eba-9ac6-4f8e-a457-4f302f79d7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ac5eba-9ac6-4f8e-a457-4f302f79d7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'volume_name': 'volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a9915-0f72-4338-9c95-2287b6077400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a9915-0f72-4338-9c95-2287b6077400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb1f814-f0da-45a1-a65d-8f08dd2b83e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:30 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Volume ab1011cf-7234-4047-8ffa-e0b3d069f1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'volume_size': 1}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:30 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 1073741824" returned: 0 in 0.791s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:30 devstack sudo[102611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023
Jun 17 04:11:30 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:31 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023" returned: 0 in 0.608s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1710807853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1011cf-7234-4047-8ffa-e0b3d069f1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1feaff407a2f468dbb41ec1a36b8b3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:30Z,use_quota=True,user_id='a6fb711aeb3d4fbca014a19d4f7b193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Creating volume ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:11:31 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:31 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 1073741824
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bcaa87-ab86-48f7-8052-93ebedf97072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a312e441-5ebf-4ab3-99b3-4244170d5023', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:31 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba929f41-556b-4c7c-bdcf-10e3fdb5f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:31 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Volume volume-a312e441-5ebf-4ab3-99b3-4244170d5023 (a312e441-5ebf-4ab3-99b3-4244170d5023): created successfully
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba929f41-556b-4c7c-bdcf-10e3fdb5f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Flow 'volume_create_manager' (d9c0d100-a3db-4eed-a7e4-2608c3a53542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ea334b6a-3c2a-4cd6-9cac-0a2555c02b56 tempest-SnapshotsActionsTest-1427780470 None] Created volume successfully.
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:31 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 1073741824" returned: 0 in 0.849s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:31 devstack sudo[102623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:31 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:32 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.741s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Creating offline snapshot 017fef2a-b8cc-4033-8e35-3436f1a6b656 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb1f814-f0da-45a1-a65d-8f08dd2b83e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f30109-09be-4b31-baf0-8f61b31d352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca535b4-69f4-4617-a3e1-e0512e427048]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:32 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Volume volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 (ab1011cf-7234-4047-8ffa-e0b3d069f1f4): created successfully
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f30109-09be-4b31-baf0-8f61b31d352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Flow 'volume_create_manager' (d345be8b-2d08-4f19-b2c2-80a03792bd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c2e59666-d6ab-4bbf-a31b-3d55759bcd67 tempest-VolumesCloneTest-205722470 None] Created volume successfully.
Jun 17 04:11:32 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023
Jun 17 04:11:32 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:33 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:33 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 1G
Jun 17 04:11:33 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Flow 'volume_create_manager' (3ac43f5d-2ec9-447e-a2e1-e2e244de944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5c3c08-48f2-4487-a567-66281bab8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5c3c08-48f2-4487-a567-66281bab8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1714169600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53c5cb5-e45a-4c0d-a063-c00c4ab79a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1feaff407a2f468dbb41ec1a36b8b3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:11:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=ab1011cf-7234-4047-8ffa-e0b3d069f1f4,status='creating',terminated_at=None,updated_at=2026-06-17T02:11:34Z,use_quota=True,user_id='a6fb711aeb3d4fbca014a19d4f7b193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f656fe0a-307f-4652-bcd3-85dba3a648be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f656fe0a-307f-4652-bcd3-85dba3a648be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3b008a-6e38-4bca-beaa-f5dae0b4fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3b008a-6e38-4bca-beaa-f5dae0b4fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f53c5cb5-e45a-4c0d-a063-c00c4ab79a02', 'volume_name': 'volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02', 'volume_size': 2, 'source_volid': 'ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'source_volstatus': 'available'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49db418a-a889-4637-bb82-e28379388173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49db418a-a889-4637-bb82-e28379388173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead2713-12ec-4d57-a80c-cbc1cf8e36ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:33 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Volume f53c5cb5-e45a-4c0d-a063-c00c4ab79a02: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02', 'volume_size': 2, 'source_volid': 'ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'source_volstatus': 'available'}
Jun 17 04:11:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:34 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 1G" returned: 0 in 0.835s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:34 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:11:34 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:34 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.770s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:34 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 is being set with open permissions: ugo+rw
Jun 17 04:11:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:34 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:11:34 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:35 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.626s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:35 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info
Jun 17 04:11:35 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:36 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:36 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info is being set with open permissions: ugo+rw
Jun 17 04:11:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:36 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info
Jun 17 04:11:36 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:36 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.info" returned: 0 in 0.642s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.207s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:36 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Cloning volume ab1011cf-7234-4047-8ffa-e0b3d069f1f4 to volume f53c5cb5-e45a-4c0d-a063-c00c4ab79a02
Jun 17 04:11:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9d91ef95-74ef-492e-a9ee-e9427ce1e7b4 tempest-SnapshotsActionsTest-1427780470 None] Create snapshot completed successfully
Jun 17 04:11:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Creating offline snapshot 09cb7cbb-f173-4cba-851d-86f8a257cb18 of volume ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:11:37 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[97022bcd-ac1c-44be-adb6-f5e5f312e312]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:37 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:37 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:37 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.891s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:37 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 1G
Jun 17 04:11:37 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ef0022f4-1555-4cb7-bb0e-3e0df371fe84 tempest-TestShelveInstance-765217980 None] Terminate volume connection completed successfully.
Jun 17 04:11:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ef0022f4-1555-4cb7-bb0e-3e0df371fe84 tempest-TestShelveInstance-765217980 None] Deleting attachment f68e9f8e-8ec3-44c2-a9f4-6f4f36801b6c. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:11:38 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 1G" returned: 0 in 1.051s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:39 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:39 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Acquiring lock "cinder-d726ed2c-a166-474d-a1e7-36dae149b170-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "cinder-d726ed2c-a166-474d-a1e7-36dae149b170-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Acquiring lock "cinder-quobyte-d726ed2c-a166-474d-a1e7-36dae149b170" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:39 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:39 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 is being set with open permissions: ugo+rw
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "cinder-quobyte-d726ed2c-a166-474d-a1e7-36dae149b170" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:39 devstack sudo[102737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:39 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a23cce5-1af5-43dd-a6f2-b5eff9815fb3]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:39 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:11:39 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:40 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.689s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:40 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info
Jun 17 04:11:40 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:40 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 0.760s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:40 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:11:40 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:40 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info" returned: 0 in 0.626s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:41 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info is being set with open permissions: ugo+rw
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:41 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info
Jun 17 04:11:41 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:41 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 1 in 0.802s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:41 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170
Jun 17 04:11:41 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:41 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.info" returned: 0 in 0.615s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] snapshot: 09cb7cbb-f173-4cba-851d-86f8a257cb18, volume: f53c5cb5-e45a-4c0d-a063-c00c4ab79a02,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[345040a8-e126-4652-bf31-be5b4d032027]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:41 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:41 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:42 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d726ed2c-a166-474d-a1e7-36dae149b170" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "cinder-quobyte-d726ed2c-a166-474d-a1e7-36dae149b170" released by "delete_volume" :: held 2.389s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.quota [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Created reservations ['6b1428ec-eaad-45e7-ad81-b596a17ce0ce', '582e8dfe-fc3c-4a33-88a3-4192e2cad25e', '502c7c59-ead2-4415-af24-44844d07bcb1', 'a019884c-e1bd-4d54-80e1-d5b962216d2e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:42 devstack sudo[102764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:42 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:42 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef17bfe0-6415-4b6c-8c0a-887823e023d2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:42 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:42 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:42 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.manager [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Deleted volume successfully.
Jun 17 04:11:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [req-c5fceaac-7314-4b9a-a7f9-99cec879625d req-ab4c947f-4440-4068-8884-d6b6c17ec1b4 tempest-TestShelveInstance-765217980 None] Lock "cinder-d726ed2c-a166-474d-a1e7-36dae149b170-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:43 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.923s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:43 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:11:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:43 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02
Jun 17 04:11:43 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:50 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" returned: 0 in 7.277s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a0547-8799-4ca0-9694-b4f253ccac65]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:50 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:50 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:52 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 1.370s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:52 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:11:52 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Converted 1024.00 MB image at 140.70 MB/s
Jun 17 04:11:52 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 is being set with open permissions: ugo+rw
Jun 17 04:11:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:52 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02
Jun 17 04:11:52 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:52 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=51,cinder:SELECT=55,cinder:INSERT=14,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:11:52 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=63,cinder:SELECT=48,cinder:DELETE=5,cinder:INSERT=11 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:11:52 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" returned: 0 in 0.892s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" released by "_copy_volume_from_snapshot" :: held 11.339s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-quobyte-09cb7cbb-f173-4cba-851d-86f8a257cb18" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-09cb7cbb-f173-4cba-851d-86f8a257cb18" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Deleting offline snapshot 09cb7cbb-f173-4cba-851d-86f8a257cb18 of volume ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] snapshot_file for this snap is: volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b240aa4-b448-4742-b31d-d9da7c2e7762]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:53 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:53 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:53 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.795s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e66ed-baac-4da0-81a6-38d87da5c5df]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:54 devstack sudo[102881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:54 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:54 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:54 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:54 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:55 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.866s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:55 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18
Jun 17 04:11:55 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:56 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4.09cb7cbb-f173-4cba-851d-86f8a257cb18" returned: 0 in 0.688s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-09cb7cbb-f173-4cba-851d-86f8a257cb18" released by "_delete_snapshot" :: held 3.294s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.466s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.695s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Creating offline snapshot 72f7a0f2-8343-4571-beae-dca31cb1e286 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead2713-12ec-4d57-a80c-cbc1cf8e36ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02', 'volume_size': 2, 'source_volid': 'ab1011cf-7234-4047-8ffa-e0b3d069f1f4', 'source_volstatus': 'available'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f10421-9981-4440-bd67-6ac537a84866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df662ebd-3945-4c7b-aa85-176f6d3d2a0f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:56 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Volume volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 (f53c5cb5-e45a-4c0d-a063-c00c4ab79a02): created successfully
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f10421-9981-4440-bd67-6ac537a84866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:11:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Flow 'volume_create_manager' (3ac43f5d-2ec9-447e-a2e1-e2e244de944e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:11:56 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c263254d-7a01-45d2-98e0-995cea84f957 tempest-VolumesCloneTest-205722470 None] Created volume successfully.
Jun 17 04:11:56 devstack sudo[102899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:11:56 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "cinder-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c16f6ef-8042-4954-8eaf-6d9da10b9c45]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:57 devstack sudo[102909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02
Jun 17 04:11:57 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:57 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 1.036s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:11:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:57 devstack sudo[102923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 1G
Jun 17 04:11:57 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:58 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" returned: 0 in 0.938s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:58 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02
Jun 17 04:11:58 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:58 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 1G" returned: 0 in 0.920s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:58 devstack sudo[102936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286
Jun 17 04:11:58 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:58 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" returned: 0 in 0.691s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02" released by "delete_volume" :: held 1.695s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:58 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Created reservations ['ab1da73d-97e9-4407-952a-96a4204c96a1', 'd6cd7faa-931f-4522-8c26-a513e3c4056d', 'f35268fc-4a4c-4e00-b178-1237d3ed7818', '3459f0cf-428d-4c8f-b8ae-f3a836b452fe'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:59 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:11:59 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:59 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286" returned: 0 in 0.781s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:59 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 is being set with open permissions: ugo+rw
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:59 devstack sudo[102945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286
Jun 17 04:11:59 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-ab1011cf-7234-4047-8ffa-e0b3d069f1f4-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "cinder-ab1011cf-7234-4047-8ffa-e0b3d069f1f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Acquiring lock "cinder-quobyte-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb81e69-a568-4648-8c1d-8b33e6fedb7b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:11:59 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:11:59 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:11:59 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.659s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:11:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Deleted volume successfully.
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-931ed7a7-72d1-4088-990c-79d5914aa201 tempest-VolumesCloneTest-205722470 None] Lock "cinder-f53c5cb5-e45a-4c0d-a063-c00c4ab79a02-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:11:59 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286" returned: 0 in 0.662s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:11:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.562s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d88f3766-d7b4-496d-85e2-eacffaeb2d0a tempest-SnapshotsActionsTest-1427780470 None] Create snapshot completed successfully
Jun 17 04:12:00 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.697s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:00 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4
Jun 17 04:12:00 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:00 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" returned: 0 in 0.576s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "cinder-quobyte-ab1011cf-7234-4047-8ffa-e0b3d069f1f4" released by "delete_volume" :: held 1.325s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Created reservations ['a2908153-9721-440c-80af-a0fba005dad9', '606c8639-c2f2-4618-9a4d-49b389a2a307', 'a4b295f3-ce62-4eab-858a-80d7d8db17b9', '7e31f101-2ce7-4efe-863c-0dce7c564ac6'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:00 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:12:00 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-72f7a0f2-8343-4571-beae-dca31cb1e286-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-72f7a0f2-8343-4571-beae-dca31cb1e286-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-72f7a0f2-8343-4571-beae-dca31cb1e286" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-72f7a0f2-8343-4571-beae-dca31cb1e286" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Deleting offline snapshot 72f7a0f2-8343-4571-beae-dca31cb1e286 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] snapshot_file for this snap is: volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f9173b-1f88-4f2e-8062-5a894100651f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:01 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286
Jun 17 04:12:01 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:01 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.599s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:12:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Deleted volume successfully.
Jun 17 04:12:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4817ff15-5bb1-4c30-bd1d-ff1a13fab657 tempest-VolumesCloneTest-205722470 None] Lock "cinder-ab1011cf-7234-4047-8ffa-e0b3d069f1f4-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:01 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488c5c4-9a54-47b5-8830-9eefd7e73b46]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:02 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:02 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:02 devstack sudo[102967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:12:02 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:02 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.731s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:02 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286
Jun 17 04:12:02 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:02 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.656s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:12:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:12:03 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286" returned: 0 in 0.803s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:03 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286
Jun 17 04:12:03 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:04 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.72f7a0f2-8343-4571-beae-dca31cb1e286" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-72f7a0f2-8343-4571-beae-dca31cb1e286" released by "_delete_snapshot" :: held 3.004s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_snapshot" :: held 3.027s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Created reservations ['90681684-698d-490f-8114-a10fb84426d4', '675ce7bc-ad49-412c-b5d0-e1deda120a1c', '99ae9786-4864-49a3-a711-8f4ff33c6180', '43861da8-d59d-41c9-9314-2559ab82d60e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:04 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Delete snapshot completed successfully.
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-373d9017-5111-4c38-a651-3b0006469c3d tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-72f7a0f2-8343-4571-beae-dca31cb1e286-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Flow 'volume_create_manager' (db361d5f-86a1-4238-8809-d96986e1948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859a4894-8c3f-4e57-969d-d736b72e55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859a4894-8c3f-4e57-969d-d736b72e55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1081119555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a56992-fc6d-4b90-85cb-03d75c3de538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61758bb0d7a432c9b50f762529d0dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:12:05Z,use_quota=True,user_id='b7bc889aa7784d7a8a58e6441e9dd7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77dacc-cc85-427e-a2e4-70b75a3b462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77dacc-cc85-427e-a2e4-70b75a3b462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5209aaa6-de6a-4ed6-97c1-2c776db16197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5209aaa6-de6a-4ed6-97c1-2c776db16197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a56992-fc6d-4b90-85cb-03d75c3de538', 'volume_name': 'volume-58a56992-fc6d-4b90-85cb-03d75c3de538', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c69c217-f55a-44fa-b404-f09b0cc90009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c69c217-f55a-44fa-b404-f09b0cc90009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53f67b4-82dc-4fc3-bb29-738f75525932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Volume 58a56992-fc6d-4b90-85cb-03d75c3de538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a56992-fc6d-4b90-85cb-03d75c3de538', 'volume_size': 1}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1081119555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a56992-fc6d-4b90-85cb-03d75c3de538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61758bb0d7a432c9b50f762529d0dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:12:05Z,use_quota=True,user_id='b7bc889aa7784d7a8a58e6441e9dd7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Creating volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:12:04 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:12:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:04 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 1073741824
Jun 17 04:12:04 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:05 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 1073741824" returned: 0 in 0.790s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:05 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538
Jun 17 04:12:05 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:06 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538" returned: 0 in 0.581s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.290s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53f67b4-82dc-4fc3-bb29-738f75525932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a56992-fc6d-4b90-85cb-03d75c3de538', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a398e6a-0ad4-4ad9-98f8-5a2c9e6bbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Creating offline snapshot 18ca1a1b-9230-4ebc-b075-30d47f0063b8 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:06 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Volume volume-58a56992-fc6d-4b90-85cb-03d75c3de538 (58a56992-fc6d-4b90-85cb-03d75c3de538): created successfully
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a398e6a-0ad4-4ad9-98f8-5a2c9e6bbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Flow 'volume_create_manager' (db361d5f-86a1-4238-8809-d96986e1948d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[88399d58-ceb7-42db-bbfa-208fb48f4a90]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-570970a5-50a3-4915-bd35-a10f42e2847a tempest-VolumesSnapshotListTestJSON-967162151 None] Created volume successfully.
Jun 17 04:12:06 devstack sudo[103005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:06 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:06 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.724s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:06 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 1G
Jun 17 04:12:06 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:07 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 1G" returned: 0 in 0.760s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:07 devstack sudo[103015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8
Jun 17 04:12:07 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:08 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8" returned: 0 in 0.630s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:08 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 is being set with open permissions: ugo+rw
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:08 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8
Jun 17 04:12:08 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:08 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8" returned: 0 in 0.573s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.954s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Creating offline snapshot de8f51d9-4d02-4310-ad42-c2161ae4b4d2 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6a2d74d5-55ad-4e64-a4de-e695a0067275 tempest-SnapshotsActionsTest-1427780470 None] Create snapshot completed successfully
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c613b3-25ae-4164-a272-ce3d4411b0c0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:09 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538
Jun 17 04:12:09 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:09 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:09 devstack sudo[103028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 1G
Jun 17 04:12:09 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-18ca1a1b-9230-4ebc-b075-30d47f0063b8-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-18ca1a1b-9230-4ebc-b075-30d47f0063b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-18ca1a1b-9230-4ebc-b075-30d47f0063b8" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-18ca1a1b-9230-4ebc-b075-30d47f0063b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Deleting offline snapshot 18ca1a1b-9230-4ebc-b075-30d47f0063b8 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] snapshot_file for this snap is: volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[026cb406-a4c1-4ca7-b230-1ccadea27173]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:10 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8
Jun 17 04:12:10 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:10 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 1G" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:10 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:10 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:10 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8" returned: 0 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[10782617-0e04-4213-ae99-34a450ad1be3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:10 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:10 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:10 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.625s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:10 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 is being set with open permissions: ugo+rw
Jun 17 04:12:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:11 devstack sudo[103046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:11 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:11 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:11 devstack sudo[103054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8
Jun 17 04:12:11 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:11 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:11 devstack sudo[103056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info
Jun 17 04:12:11 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:12 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info" returned: 0 in 0.640s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:12 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info is being set with open permissions: ugo+rw
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:12 devstack sudo[103062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info
Jun 17 04:12:12 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:12 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8" returned: 0 in 0.839s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:12 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8
Jun 17 04:12:12 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:12 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.info" returned: 0 in 0.613s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.022s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6c1f84b1-be49-4a09-b28f-508ad96f43e1 tempest-VolumesSnapshotListTestJSON-967162151 None] Create snapshot completed successfully
Jun 17 04:12:13 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.18ca1a1b-9230-4ebc-b075-30d47f0063b8" returned: 0 in 0.638s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-18ca1a1b-9230-4ebc-b075-30d47f0063b8" released by "_delete_snapshot" :: held 3.016s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_snapshot" :: held 3.045s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Created reservations ['011c0ba0-e5e3-40b6-b272-8870ddaf6ac5', '4103111a-5d0a-4f3f-843e-ea2ceb7c21ed', 'a17cb57e-ed9a-41f5-b455-8abdb6606d77', '0a30f18c-5ef7-4636-a47e-de2de384b63e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Delete snapshot completed successfully.
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-00627101-190f-4b00-9fab-e70069446b12 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-18ca1a1b-9230-4ebc-b075-30d47f0063b8-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Creating offline snapshot d10082fe-da2d-4142-8129-0da49be01d75 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d5c92-ec2d-4059-bde9-100d156af03d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:13 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:13 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:14 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.759s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:14 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 1G
Jun 17 04:12:14 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:15 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 1G" returned: 0 in 0.844s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:15 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:15 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:15 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.642s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:15 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 is being set with open permissions: ugo+rw
Jun 17 04:12:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:15 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:15 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:16 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.571s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.865s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Creating offline snapshot e93077f4-25b3-438c-bf2e-f0f63f753592 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[73714ffc-d222-4321-96b5-44439fc691a1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-08a9c834-418e-4e41-954a-10b9d1b450d0 tempest-VolumesSnapshotListTestJSON-967162151 None] Create snapshot completed successfully
Jun 17 04:12:16 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:16 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:17 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.711s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:17 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 1G
Jun 17 04:12:17 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:17 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 1G" returned: 0 in 0.753s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:18 devstack sudo[103132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592
Jun 17 04:12:18 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:18 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592" returned: 0 in 0.631s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:18 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 is being set with open permissions: ugo+rw
Jun 17 04:12:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:18 devstack sudo[103138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592
Jun 17 04:12:18 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:19 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592" returned: 0 in 0.592s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.446s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Creating offline snapshot 23db4fbf-eaad-4853-ba86-9b964e5b3af8 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8dac78dc-00dc-4119-a4d6-cca34e334ab7 tempest-SnapshotsActionsTest-1427780470 None] Create snapshot completed successfully
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed943e-84c8-457e-935d-efc97d8d606a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:19 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:19 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-e93077f4-25b3-438c-bf2e-f0f63f753592-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-e93077f4-25b3-438c-bf2e-f0f63f753592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-e93077f4-25b3-438c-bf2e-f0f63f753592" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-e93077f4-25b3-438c-bf2e-f0f63f753592" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Deleting offline snapshot e93077f4-25b3-438c-bf2e-f0f63f753592 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] snapshot_file for this snap is: volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2950d0c-5ca2-4176-b56c-9152f63e87fd]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:20 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.857s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:20 devstack sudo[103154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 1G
Jun 17 04:12:20 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:20 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592
Jun 17 04:12:20 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:20 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592" returned: 0 in 0.821s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[94580667-8770-477b-b7c2-ca63d0766312]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:21 devstack sudo[103165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:21 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:21 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 1G" returned: 0 in 0.876s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:21 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8
Jun 17 04:12:21 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:21 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.704s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:21 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592
Jun 17 04:12:21 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:21 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8" returned: 0 in 0.633s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:21 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 is being set with open permissions: ugo+rw
Jun 17 04:12:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:21 devstack sudo[103177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8
Jun 17 04:12:21 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-033610c0-7a09-44ef-b85d-17e80bb444da req-3af48c71-1a6b-41c0-84ef-eb1bbd3f7e4f tempest-AttachVolumeNegativeTest-2076455395 None] Terminate volume connection completed successfully.
Jun 17 04:12:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-033610c0-7a09-44ef-b85d-17e80bb444da req-3af48c71-1a6b-41c0-84ef-eb1bbd3f7e4f tempest-AttachVolumeNegativeTest-2076455395 None] Deleting attachment 5758aa19-952e-479f-9e98-b2fab72a1f1e. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:12:22 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8" returned: 0 in 0.651s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3274a78d-c25c-4c7e-8772-21f0872fd206 tempest-VolumesSnapshotListTestJSON-967162151 None] Create snapshot completed successfully
Jun 17 04:12:22 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592" returned: 0 in 0.786s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:22 devstack sudo[103187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592
Jun 17 04:12:22 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:23 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e93077f4-25b3-438c-bf2e-f0f63f753592" returned: 0 in 0.597s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-e93077f4-25b3-438c-bf2e-f0f63f753592" released by "_delete_snapshot" :: held 3.027s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_snapshot" :: held 3.061s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Created reservations ['02f6412c-a63b-4519-9025-7497c80b79ea', '9f6adf9a-4b4b-4937-bd21-8ec77e127b34', 'ea6fe071-e341-4638-a827-ee6e4bcfc5bd', '13504370-102a-40de-b5a6-f8bcd2ed8d32'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Delete snapshot completed successfully.
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b19c2658-cbdf-4ad6-8850-8294295f8d80 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-e93077f4-25b3-438c-bf2e-f0f63f753592-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-23db4fbf-eaad-4853-ba86-9b964e5b3af8-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-23db4fbf-eaad-4853-ba86-9b964e5b3af8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-23db4fbf-eaad-4853-ba86-9b964e5b3af8" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-23db4fbf-eaad-4853-ba86-9b964e5b3af8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Deleting offline snapshot 23db4fbf-eaad-4853-ba86-9b964e5b3af8 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] snapshot_file for this snap is: volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[af734299-2f20-484d-93be-1f71e9d596fc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:24 devstack sudo[103190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8
Jun 17 04:12:24 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Creating offline snapshot e8504933-6ff2-4856-8822-896de3450cb9 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e15b3f-3b2b-4e97-ad5d-41c9a66524cc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:24 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:24 devstack sudo[103195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:24 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cab317-2813-47bd-beec-5a16c30e082c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:24 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:24 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:25 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.922s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:25 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 1G
Jun 17 04:12:25 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:25 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.909s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:25 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8
Jun 17 04:12:25 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:26 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 1G" returned: 0 in 0.890s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:26 devstack sudo[103260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9
Jun 17 04:12:26 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:26 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8" returned: 0 in 0.886s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:26 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8
Jun 17 04:12:26 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:27 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.23db4fbf-eaad-4853-ba86-9b964e5b3af8" returned: 0 in 0.598s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:27 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:27 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 is being set with open permissions: ugo+rw
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-23db4fbf-eaad-4853-ba86-9b964e5b3af8" released by "_delete_snapshot" :: held 3.311s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:27 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9
Jun 17 04:12:27 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" released by "delete_snapshot" :: held 3.349s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Created reservations ['4a320196-62c8-4801-918d-febd2d442700', 'cbb60e65-4184-451c-8120-427e31ae0f96', '6333e9e2-89e6-43aa-befd-3a356083eb17', '50383362-5e6e-45fb-b101-96803b36be89'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Delete snapshot completed successfully.
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bf09a61d-7a92-4145-b128-85023ac8e755 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-23db4fbf-eaad-4853-ba86-9b964e5b3af8-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:27 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9" returned: 0 in 0.613s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.264s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ece9d9ac-1a8f-4c89-891e-ca1241ffb05c tempest-SnapshotsActionsTest-1427780470 None] Create snapshot completed successfully
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-d10082fe-da2d-4142-8129-0da49be01d75-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-d10082fe-da2d-4142-8129-0da49be01d75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-d10082fe-da2d-4142-8129-0da49be01d75" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-d10082fe-da2d-4142-8129-0da49be01d75" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Deleting offline snapshot d10082fe-da2d-4142-8129-0da49be01d75 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] snapshot_file for this snap is: volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58adae29-bfba-4020-9277-28dc8babbfb6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:28 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:28 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-e8504933-6ff2-4856-8822-896de3450cb9-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-e8504933-6ff2-4856-8822-896de3450cb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.717s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Acquiring lock "cinder-quobyte-e8504933-6ff2-4856-8822-896de3450cb9" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9197149-7b3f-4bde-bc6f-459f8bb823d7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-e8504933-6ff2-4856-8822-896de3450cb9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Deleting offline snapshot e8504933-6ff2-4856-8822-896de3450cb9 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] snapshot_file for this snap is: volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd71c7b0-f629-4de4-8d3e-7b555e04367c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:28 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:28 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:29 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9
Jun 17 04:12:29 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:29 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:29 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9" returned: 0 in 0.700s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.768s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf778a-450e-4ec0-9385-1b2c9e8f869e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:29 devstack sudo[103291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:29 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:29 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:29 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:30 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:30 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75
Jun 17 04:12:30 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:30 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:30 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9
Jun 17 04:12:30 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:30 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.d10082fe-da2d-4142-8129-0da49be01d75" returned: 0 in 0.620s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-d10082fe-da2d-4142-8129-0da49be01d75" released by "_delete_snapshot" :: held 2.899s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" released by "delete_snapshot" :: held 2.918s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Created reservations ['0900b5be-733e-480f-9f69-51002ea3b649', '5e653cc1-9801-4695-a251-9f00c4dca787', '7947f468-0d2d-4379-b748-4b5f40ef14a1', '22677b0d-4910-48b7-b535-2b722e63f4ef'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Delete snapshot completed successfully.
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c4c335d9-63bc-4104-a810-1f5128fd5dd0 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-d10082fe-da2d-4142-8129-0da49be01d75-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:31 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9" returned: 0 in 0.742s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:31 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9
Jun 17 04:12:31 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-de8f51d9-4d02-4310-ad42-c2161ae4b4d2-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-de8f51d9-4d02-4310-ad42-c2161ae4b4d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-de8f51d9-4d02-4310-ad42-c2161ae4b4d2" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-de8f51d9-4d02-4310-ad42-c2161ae4b4d2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Deleting offline snapshot de8f51d9-4d02-4310-ad42-c2161ae4b4d2 of volume 58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] snapshot_file for this snap is: volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ac43a-f167-43e3-8161-48240e280d12]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:31 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:31 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:31 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.e8504933-6ff2-4856-8822-896de3450cb9" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-e8504933-6ff2-4856-8822-896de3450cb9" released by "_delete_snapshot" :: held 2.873s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_snapshot" :: held 2.907s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Created reservations ['e40f47fb-bb6d-4b0a-b5d7-3bf60ef3dfb3', '35bd7664-ed7b-4164-a3f8-5ad0a16de813', 'd44dd90a-72db-4c31-a29d-420ebdfc0d7e', '49532e95-db09-4523-b2f3-025e5e59c533'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Delete snapshot completed successfully.
Jun 17 04:12:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-367af60c-0182-4b9d-94af-0b4ea7975f60 tempest-SnapshotsActionsTest-1041354568 None] Lock "cinder-e8504933-6ff2-4856-8822-896de3450cb9-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:32 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.782s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a56992-fc6d-4b90-85cb-03d75c3de538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b3fbf-770d-4d93-bf64-5cd3da9975a7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:32 devstack sudo[103324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538
Jun 17 04:12:32 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "cinder-017fef2a-b8cc-4033-8e35-3436f1a6b656-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-017fef2a-b8cc-4033-8e35-3436f1a6b656-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "cinder-quobyte-017fef2a-b8cc-4033-8e35-3436f1a6b656" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-017fef2a-b8cc-4033-8e35-3436f1a6b656" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Deleting offline snapshot 017fef2a-b8cc-4033-8e35-3436f1a6b656 of volume a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] snapshot_file for this snap is: volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b21a4b-ae5c-440e-9cd4-e0b7ed39c198]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:32 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:32 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:32 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538" returned: 0 in 0.833s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:33 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:33 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:33 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.771s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a312e441-5ebf-4ab3-99b3-4244170d5023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[84229adf-c5db-4cea-a02b-37f4ebe5b090]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:33 devstack sudo[103337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023
Jun 17 04:12:33 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:33 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.760s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:33 devstack sudo[103343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2
Jun 17 04:12:33 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:34 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023" returned: 0 in 0.801s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:34 devstack sudo[103348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:34 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:34 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538.de8f51d9-4d02-4310-ad42-c2161ae4b4d2" returned: 0 in 0.614s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-de8f51d9-4d02-4310-ad42-c2161ae4b4d2" released by "_delete_snapshot" :: held 3.112s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" released by "delete_snapshot" :: held 3.136s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Created reservations ['42a27abe-d636-448b-92ab-90643f2f84bd', '8c4cf0b7-f5d7-4c87-bfd5-1cfb72f1ed9d', 'c40b7bc0-9954-4c16-806e-0f99d251c8f4', '8778c9f7-2cd3-4c4e-b363-18afe7ea6c10'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Delete snapshot completed successfully.
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01cfec45-ad76-46b5-b38d-a82040517c58 tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-de8f51d9-4d02-4310-ad42-c2161ae4b4d2-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:34 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.729s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:34 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656
Jun 17 04:12:34 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:35 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023.017fef2a-b8cc-4033-8e35-3436f1a6b656" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-017fef2a-b8cc-4033-8e35-3436f1a6b656" released by "_delete_snapshot" :: held 3.057s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_snapshot" :: held 3.093s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-58a56992-fc6d-4b90-85cb-03d75c3de538-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-58a56992-fc6d-4b90-85cb-03d75c3de538-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Created reservations ['0f2d6c8b-25da-4a57-b029-82f807038cad', 'f7af31c3-8c3e-4018-994a-a88b3f016fe6', '37c3e0ed-3b8f-406f-a0e4-a41933e94ade', '8b9a51b2-4dcb-498f-a2ef-a213c9e42906'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d266220-7d1e-4b78-8927-bca7fdeed9dc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Delete snapshot completed successfully.
Jun 17 04:12:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-129bd8d3-8562-404f-8f97-dbabb0162857 tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-017fef2a-b8cc-4033-8e35-3436f1a6b656-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:35 devstack sudo[103361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538
Jun 17 04:12:35 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:36 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538" returned: 0 in 0.702s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:36 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538
Jun 17 04:12:36 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "cinder-a312e441-5ebf-4ab3-99b3-4244170d5023-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-a312e441-5ebf-4ab3-99b3-4244170d5023-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd80cbf-8ca8-46cd-9e0d-dce13d5b7d47]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:12:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:37 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023
Jun 17 04:12:37 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:37 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-58a56992-fc6d-4b90-85cb-03d75c3de538" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-quobyte-58a56992-fc6d-4b90-85cb-03d75c3de538" released by "delete_volume" :: held 1.379s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Created reservations ['9265486a-3001-44d5-8f78-83a4dbe5ed9c', '17a59262-84df-41f8-9dfb-b11e30228c1b', '8568f2f9-7e17-4d0f-836e-d9153dfa0f93', 'da4c9aa9-3910-4104-b66d-8dbfff2f9757'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:37 devstack sudo[103371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:12:37 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:37 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023" returned: 0 in 0.703s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:37 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023
Jun 17 04:12:37 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:37 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.598s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:12:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Deleted volume successfully.
Jun 17 04:12:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-37cdd9ad-0e17-41de-a9c2-6aec73f30ffa tempest-VolumesSnapshotListTestJSON-967162151 None] Lock "cinder-58a56992-fc6d-4b90-85cb-03d75c3de538-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:38 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a312e441-5ebf-4ab3-99b3-4244170d5023" returned: 0 in 0.642s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-quobyte-a312e441-5ebf-4ab3-99b3-4244170d5023" released by "delete_volume" :: held 1.405s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Created reservations ['debe9551-a28c-4106-b466-359422202c47', '59dfd015-ca42-48f5-beef-efce90c5be49', 'e73c0d2c-4d30-4ee5-8a74-929136db3258', '6780e532-d1d5-4e55-84bb-9ad83975b062'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:12:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:12:38 devstack sudo[103380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:12:38 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:12:39 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root
Jun 17 04:12:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.669s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:12:39 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:12:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Deleted volume successfully.
Jun 17 04:12:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69c8b7c7-63b9-475d-905e-188c4bd1f21c tempest-SnapshotsActionsTest-1427780470 None] Lock "cinder-a312e441-5ebf-4ab3-99b3-4244170d5023-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:12:48 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=92,cinder:SELECT=73,cinder:INSERT=23,cinder:DELETE=6 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:12:49 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=87,cinder:SELECT=87,cinder:INSERT=28,cinder:DELETE=7 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:02 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:13:02 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:02 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.621s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:13:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Flow 'volume_create_manager' (cd0ab548-acde-46de-a2b1-2383ebbe2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b1d451-3ab8-4d3c-8808-0b9827f65357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b1d451-3ab8-4d3c-8808-0b9827f65357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-272726518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645de7c7-4c66-49d8-b7e3-349f2a29540d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc4cd511da4f5ab5c7ba89a608108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:04Z,use_quota=True,user_id='e025db1d0de24f309d04aad3f06c1246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f5b27-7ad0-44d1-bf07-4501cc97b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f5b27-7ad0-44d1-bf07-4501cc97b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e928ef-0b4c-4913-9d47-ca192ff505a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e928ef-0b4c-4913-9d47-ca192ff505a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645de7c7-4c66-49d8-b7e3-349f2a29540d', 'volume_name': 'volume-645de7c7-4c66-49d8-b7e3-349f2a29540d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710fd029-c6d7-4887-a93a-ca92a7bcec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710fd029-c6d7-4887-a93a-ca92a7bcec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6f9d9-cbbd-4515-9c5c-f85a2fd8d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Volume 645de7c7-4c66-49d8-b7e3-349f2a29540d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645de7c7-4c66-49d8-b7e3-349f2a29540d', 'volume_size': 1}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-272726518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645de7c7-4c66-49d8-b7e3-349f2a29540d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc4cd511da4f5ab5c7ba89a608108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:04Z,use_quota=True,user_id='e025db1d0de24f309d04aad3f06c1246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Creating volume 645de7c7-4c66-49d8-b7e3-349f2a29540d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:13:04 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:13:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:04 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d 1073741824
Jun 17 04:13:04 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:05 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d 1073741824" returned: 0 in 0.844s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:05 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d
Jun 17 04:13:05 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:05 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d" returned: 0 in 0.590s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:13:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6f9d9-cbbd-4515-9c5c-f85a2fd8d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645de7c7-4c66-49d8-b7e3-349f2a29540d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d03329-82ac-4cf4-a0a4-6a834580cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:06 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Volume volume-645de7c7-4c66-49d8-b7e3-349f2a29540d (645de7c7-4c66-49d8-b7e3-349f2a29540d): created successfully
Jun 17 04:13:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d03329-82ac-4cf4-a0a4-6a834580cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Flow 'volume_create_manager' (cd0ab548-acde-46de-a2b1-2383ebbe2861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-cfd35c47-bb87-46f2-91a5-6d5958f15942 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Created volume successfully.
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Acquiring lock "cinder-645de7c7-4c66-49d8-b7e3-349f2a29540d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "cinder-645de7c7-4c66-49d8-b7e3-349f2a29540d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Acquiring lock "cinder-quobyte-645de7c7-4c66-49d8-b7e3-349f2a29540d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "cinder-quobyte-645de7c7-4c66-49d8-b7e3-349f2a29540d" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db8ffe-6b57-4696-8c1c-79d78db67571]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:07 devstack sudo[103551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d
Jun 17 04:13:07 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:08 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d" returned: 0 in 0.752s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:08 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d
Jun 17 04:13:08 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:09 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-645de7c7-4c66-49d8-b7e3-349f2a29540d" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "cinder-quobyte-645de7c7-4c66-49d8-b7e3-349f2a29540d" released by "delete_volume" :: held 1.459s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Created reservations ['a9774ec4-7176-44c3-866b-874161f6dfd4', '965575ca-346a-43fe-a9c4-2189b7dd233f', 'fb9b063d-63ca-4f26-859d-7de867be50cc', '12662eca-cea9-4da9-9e53-3033e484f744'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:09 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:13:09 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:09 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:13:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Deleted volume successfully.
Jun 17 04:13:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-06def4c4-72ac-4a77-824f-607e56501e28 tempest-VolumeQuotasNegativeTestJSON-259505040 None] Lock "cinder-645de7c7-4c66-49d8-b7e3-349f2a29540d-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (17426170-296c-42dd-92fa-87e4c60f068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06107744-4b3c-40f7-ad28-adac353fca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06107744-4b3c-40f7-ad28-adac353fca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1827016705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61664fe-a23c-4f8e-8dc1-4dadc855c288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:13Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab64da8f-0da7-441c-8db4-18364ee8f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab64da8f-0da7-441c-8db4-18364ee8f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463d19bb-c920-4d53-ad1a-55d22e73f824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463d19bb-c920-4d53-ad1a-55d22e73f824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61664fe-a23c-4f8e-8dc1-4dadc855c288', 'volume_name': 'volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7552bf-97cf-4300-97fb-da127eb8d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7552bf-97cf-4300-97fb-da127eb8d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca41ac34-4eb3-4c55-9afe-98741968e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Volume e61664fe-a23c-4f8e-8dc1-4dadc855c288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288', 'volume_size': 1}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1827016705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61664fe-a23c-4f8e-8dc1-4dadc855c288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:13Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Creating volume e61664fe-a23c-4f8e-8dc1-4dadc855c288 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:13:13 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:13 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 1073741824
Jun 17 04:13:13 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:13 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 1073741824" returned: 0 in 0.891s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:14 devstack sudo[103572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288
Jun 17 04:13:14 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:14 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288" returned: 0 in 0.659s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca41ac34-4eb3-4c55-9afe-98741968e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba1db7f-fa7a-41b5-afab-97d889f1d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:14 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Volume volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 (e61664fe-a23c-4f8e-8dc1-4dadc855c288): created successfully
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba1db7f-fa7a-41b5-afab-97d889f1d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (17426170-296c-42dd-92fa-87e4c60f068f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-76816036-ea9c-4097-9c2d-6d4946d029aa tempest-AttachVolumeNegativeTest-2076455395 None] Created volume successfully.
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Flow 'volume_create_manager' (97e7e109-4b93-42c2-9cb8-37aed64a8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e78cc4-529a-4bb5-a7bc-deae21a6deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e78cc4-529a-4bb5-a7bc-deae21a6deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-828899489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9f8bc3-0562-4477-8783-0a856df5a839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2700116e7245a581ae53ddbdee4d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:16Z,use_quota=True,user_id='f5a5414b3673454987ae2c3b5097ab1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3bac6c-159a-411a-bd27-6363a13363b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3bac6c-159a-411a-bd27-6363a13363b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e62ba7-f6bc-4a9d-93ee-8f16040fe0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e62ba7-f6bc-4a9d-93ee-8f16040fe0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9f8bc3-0562-4477-8783-0a856df5a839', 'volume_name': 'volume-bb9f8bc3-0562-4477-8783-0a856df5a839', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e9a5b-a371-4eb4-a472-a411e9ef79bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e9a5b-a371-4eb4-a472-a411e9ef79bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b068b3-9309-405d-b528-8a72e408f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:15 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Volume bb9f8bc3-0562-4477-8783-0a856df5a839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9f8bc3-0562-4477-8783-0a856df5a839', 'volume_size': 1}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-828899489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9f8bc3-0562-4477-8783-0a856df5a839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2700116e7245a581ae53ddbdee4d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:16Z,use_quota=True,user_id='f5a5414b3673454987ae2c3b5097ab1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Creating volume bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:13:15 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:13:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:15 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 1073741824
Jun 17 04:13:15 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:16 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 1073741824" returned: 0 in 0.902s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:16 devstack sudo[103601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839
Jun 17 04:13:16 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:17 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839" returned: 0 in 0.596s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b068b3-9309-405d-b528-8a72e408f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9f8bc3-0562-4477-8783-0a856df5a839', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1fa33a-664f-4a73-810e-f2361c60bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:17 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Volume volume-bb9f8bc3-0562-4477-8783-0a856df5a839 (bb9f8bc3-0562-4477-8783-0a856df5a839): created successfully
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1fa33a-664f-4a73-810e-f2361c60bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Flow 'volume_create_manager' (97e7e109-4b93-42c2-9cb8-37aed64a8650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9c054311-9052-41a9-a730-14dda3c34a07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Created volume successfully.
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Creating offline snapshot a12d8fa6-5196-4021-8803-cba31c82efb8 of volume bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a9624c-2a64-4211-95d9-37cadeac20fe]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:18 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839
Jun 17 04:13:18 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:18 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839" returned: 0 in 0.727s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:18 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 1G
Jun 17 04:13:18 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:19 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 1G" returned: 0 in 0.728s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9f8bc3-0562-4477-8783-0a856df5a839 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:19 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9f8bc3-0562-4477-8783-0a856df5a839 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8
Jun 17 04:13:19 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:20 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9f8bc3-0562-4477-8783-0a856df5a839 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8" returned: 0 in 0.643s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:20 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 is being set with open permissions: ugo+rw
Jun 17 04:13:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:20 devstack sudo[103645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8
Jun 17 04:13:20 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:20 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:20 devstack sudo[103699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info
Jun 17 04:13:20 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:21 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info" returned: 0 in 0.892s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:21 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info is being set with open permissions: ugo+rw
Jun 17 04:13:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:21 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info
Jun 17 04:13:21 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:22 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.info" returned: 0 in 0.653s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.264s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4697705-c301-44eb-b743-6d60cb61e915]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-360bb220-42b3-478f-9619-9bf992d8aff7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Create snapshot completed successfully
Jun 17 04:13:22 devstack sudo[103731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288
Jun 17 04:13:22 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:23 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288" returned: 0 in 0.843s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28b69cf-b8ea-4ba1-9b72-402ef2b49f12', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:13:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-1f9748ae-23ad-4a85-a14f-35b2c7d568e3 req-8ef0302c-19a4-44f9-b4e1-66496b1c1263 tempest-AttachVolumeNegativeTest-2076455395 None] attachment_update completed successfully.
Jun 17 04:13:23 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "cinder-a12d8fa6-5196-4021-8803-cba31c82efb8-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-a12d8fa6-5196-4021-8803-cba31c82efb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" acquired by "delete_snapshot" :: waited 0.083s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "cinder-quobyte-a12d8fa6-5196-4021-8803-cba31c82efb8" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-a12d8fa6-5196-4021-8803-cba31c82efb8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Deleting offline snapshot a12d8fa6-5196-4021-8803-cba31c82efb8 of volume bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] snapshot_file for this snap is: volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c77dc-de87-4c88-99af-d3f64c3ddeef]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:24 devstack sudo[103804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8
Jun 17 04:13:24 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:25 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8" returned: 0 in 0.867s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb9f8bc3-0562-4477-8783-0a856df5a839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[054898ef-9f3c-4d21-bdcd-933a1f8e0523]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:25 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839
Jun 17 04:13:25 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Flow 'volume_create_manager' (52d29c65-65a4-4031-8730-9540511078cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3548bb1c-e2d7-4942-8e2e-6b24e967fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3548bb1c-e2d7-4942-8e2e-6b24e967fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-491915067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452f311f-12ab-4840-a3a3-6eac85453ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5bcb0c1ae74ee9b35b5919e9821fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:25Z,use_quota=True,user_id='8e750e64adfe49138cd9b73540488cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6491ca44-6bb9-4e1e-a774-f0e27170f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6491ca44-6bb9-4e1e-a774-f0e27170f012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7fde8-5e73-4be0-800a-4de0d89f22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7fde8-5e73-4be0-800a-4de0d89f22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452f311f-12ab-4840-a3a3-6eac85453ea8', 'volume_name': 'volume-452f311f-12ab-4840-a3a3-6eac85453ea8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab485eb-b997-452a-9ec8-6345238ccccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab485eb-b997-452a-9ec8-6345238ccccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013f600-10f9-473a-95c5-34e842a13a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Volume 452f311f-12ab-4840-a3a3-6eac85453ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452f311f-12ab-4840-a3a3-6eac85453ea8', 'volume_size': 1}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-491915067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452f311f-12ab-4840-a3a3-6eac85453ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5bcb0c1ae74ee9b35b5919e9821fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:25Z,use_quota=True,user_id='8e750e64adfe49138cd9b73540488cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Creating volume 452f311f-12ab-4840-a3a3-6eac85453ea8 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:13:25 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:25 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 1073741824
Jun 17 04:13:25 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:25 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839" returned: 0 in 0.794s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:25 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8
Jun 17 04:13:25 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:26 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 1073741824" returned: 0 in 0.795s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:26 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8
Jun 17 04:13:26 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:26 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8" returned: 0 in 0.765s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:26 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8
Jun 17 04:13:26 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:27 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8" returned: 0 in 0.665s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013f600-10f9-473a-95c5-34e842a13a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452f311f-12ab-4840-a3a3-6eac85453ea8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f584ce-8e53-46c0-a101-d5bc952ab8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:27 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Volume volume-452f311f-12ab-4840-a3a3-6eac85453ea8 (452f311f-12ab-4840-a3a3-6eac85453ea8): created successfully
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f584ce-8e53-46c0-a101-d5bc952ab8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Flow 'volume_create_manager' (52d29c65-65a4-4031-8730-9540511078cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9076fbde-78e5-4c8f-be01-e22389e63877 tempest-TestMinimumBasicScenario-746423511 None] Created volume successfully.
Jun 17 04:13:27 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839.a12d8fa6-5196-4021-8803-cba31c82efb8" returned: 0 in 0.672s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-a12d8fa6-5196-4021-8803-cba31c82efb8" released by "_delete_snapshot" :: held 3.254s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" released by "delete_snapshot" :: held 3.287s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Created reservations ['40aa0d9c-3c65-490d-8f4e-595e37deb009', 'd3844b40-f79d-4fef-b3ae-75da2e93ddec', '6c295d08-c355-4503-b933-7cea35b57392', '4a598c03-b162-4940-bbcf-3fad6e941dbc'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:13:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Delete snapshot completed successfully.
Jun 17 04:13:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53566501-3e47-4cfb-9af4-efc272867a84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-a12d8fa6-5196-4021-8803-cba31c82efb8-delete_snapshot" released by "delete_snapshot" :: held 3.565s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "cinder-bb9f8bc3-0562-4477-8783-0a856df5a839-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-bb9f8bc3-0562-4477-8783-0a856df5a839-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8359cf0-b0dc-42fe-bb71-fbf967f13064]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:28 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839
Jun 17 04:13:28 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:29 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839" returned: 0 in 0.732s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:29 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839
Jun 17 04:13:29 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:29 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-0a907bcd-1149-40ad-b934-8aef37e60d7d req-75e683b0-f40a-4715-aa1d-df87658e6e0a tempest-AttachVolumeNegativeTest-2076455395 None] Terminate volume connection completed successfully.
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-0a907bcd-1149-40ad-b934-8aef37e60d7d req-75e683b0-f40a-4715-aa1d-df87658e6e0a tempest-AttachVolumeNegativeTest-2076455395 None] Deleting attachment d28b69cf-b8ea-4ba1-9b72-402ef2b49f12. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:13:29 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bb9f8bc3-0562-4477-8783-0a856df5a839" returned: 0 in 0.652s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-quobyte-bb9f8bc3-0562-4477-8783-0a856df5a839" released by "delete_volume" :: held 1.444s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:29 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Created reservations ['bde45a17-488e-4b89-a9ea-176c65f5f301', '1b866dbf-53d0-4b79-bf5a-6534a9c671e7', '694b76c6-8852-4e15-a075-f70e3dc20e78', 'f1c6bc43-ea59-4794-b717-242bb410ceda'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:30 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:13:30 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:30 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.669s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:13:30 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Deleted volume successfully.
Jun 17 04:13:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ea14315-e3b4-4636-8fda-49f36df502ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1938665967 None] Lock "cinder-bb9f8bc3-0562-4477-8783-0a856df5a839-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c184925-e190-4d0b-b731-3b733e78668b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:31 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8
Jun 17 04:13:31 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:31 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8" returned: 0 in 0.916s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-452f311f-12ab-4840-a3a3-6eac85453ea8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f10cc90c-981e-4260-af92-df38ed1ec6d2', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:13:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-3fbdcf17-06ec-42c6-a95c-6544e52703c4 req-aca50188-6531-4746-8639-bf211b3eea1d tempest-TestMinimumBasicScenario-746423511 None] attachment_update completed successfully.
Jun 17 04:13:42 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=37,cinder:UPDATE=39,cinder:INSERT=6,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:13:42 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=38,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=4 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Flow 'volume_create_manager' (b53ded09-b852-4c97-824d-1c527ad1326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea46826-b57e-4936-9e44-592072686c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea46826-b57e-4936-9e44-592072686c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-963020871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6d5d3b764c4ec298289e3b6192e6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:47Z,use_quota=True,user_id='b29089651a274d60bb0acd01043554a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da3ebc8-5b22-494d-88ad-99528c8fb5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da3ebc8-5b22-494d-88ad-99528c8fb5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8575e470-b9e7-4159-9933-590e6eba68d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8575e470-b9e7-4159-9933-590e6eba68d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4', 'volume_name': 'volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4', 'volume_size': 2}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540ab00-ed64-413b-9021-60abf04688b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540ab00-ed64-413b-9021-60abf04688b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11142ec-b54d-46c2-a006-167b2c2eb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:47 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Volume 5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4', 'volume_size': 2}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-963020871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6d5d3b764c4ec298289e3b6192e6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:13:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:13:47Z,use_quota=True,user_id='b29089651a274d60bb0acd01043554a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Creating volume 5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:13:47 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:13:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 2147483648 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:47 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 2147483648
Jun 17 04:13:47 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:48 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 2147483648" returned: 0 in 0.802s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:48 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4
Jun 17 04:13:48 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:48 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11142ec-b54d-46c2-a006-167b2c2eb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4', 'volume_size': 2}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193f1d0-5035-44db-9e42-35d60758da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:13:48 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Volume volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 (5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4): created successfully
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193f1d0-5035-44db-9e42-35d60758da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:13:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Flow 'volume_create_manager' (b53ded09-b852-4c97-824d-1c527ad1326d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:13:48 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f46bf9be-e1d4-4f96-957c-3c826c786c41 tempest-VolumesCloneNegativeTest-429303215 None] Created volume successfully.
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Acquiring lock "cinder-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "cinder-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Acquiring lock "cinder-quobyte-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "cinder-quobyte-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c42d38-4a8e-4af0-a2f7-9fe9886f8506]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:13:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:49 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4
Jun 17 04:13:49 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:50 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" returned: 0 in 0.817s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:50 devstack sudo[104723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4
Jun 17 04:13:50 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:51 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "cinder-quobyte-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4" released by "delete_volume" :: held 1.504s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Created reservations ['18449c85-8964-4256-8b2a-ce688884dfc8', '3d9c3d08-a081-4474-91f1-169e120454b2', '4c85633f-ff07-44cd-8eb7-d0555e1a2c62', 'f93b9a74-5af9-4ec4-ad33-b963d8d40c14'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:13:51 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:13:51 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:13:51 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.591s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:13:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Deleted volume successfully.
Jun 17 04:13:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ea603fef-c4a6-4683-843b-2ee3d5c0c13b tempest-VolumesCloneNegativeTest-429303215 None] Lock "cinder-5d614fa1-c6d8-4f8d-8a7e-ef70ae269fc4-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:01 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:14:01 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:02 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:14:02 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:03 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.185s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:14:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:14:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:14:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:14:18 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:14:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (2fddb893-9226-4a18-a4b4-0058cb7a3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274dec80-5f94-4854-8c31-16e5efc8867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274dec80-5f94-4854-8c31-16e5efc8867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-42628380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c8df1b-ce09-4e9d-b315-f1ada664539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:19Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b564de-391a-4d1b-8186-c4dad21f1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b564de-391a-4d1b-8186-c4dad21f1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f37e71-f9ee-477e-aec1-72f2552d2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f37e71-f9ee-477e-aec1-72f2552d2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c8df1b-ce09-4e9d-b315-f1ada664539f', 'volume_name': 'volume-42c8df1b-ce09-4e9d-b315-f1ada664539f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543fae9b-ec9d-479e-b2d3-e587361b6564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543fae9b-ec9d-479e-b2d3-e587361b6564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e120466f-c0b7-41fd-9ec3-c00b1eb6dd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Volume 42c8df1b-ce09-4e9d-b315-f1ada664539f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c8df1b-ce09-4e9d-b315-f1ada664539f', 'volume_size': 1}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-42628380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c8df1b-ce09-4e9d-b315-f1ada664539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41be5e1630f54d2386992e9a42c1e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:19Z,use_quota=True,user_id='10676b5545714b00b0d5435c13698491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Creating volume 42c8df1b-ce09-4e9d-b315-f1ada664539f {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:14:19 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:19 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f 1073741824
Jun 17 04:14:19 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:19 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f 1073741824" returned: 0 in 0.831s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:19 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f
Jun 17 04:14:19 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:20 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f" returned: 0 in 0.637s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e120466f-c0b7-41fd-9ec3-c00b1eb6dd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c8df1b-ce09-4e9d-b315-f1ada664539f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e664be3b-3161-447e-801d-137b543cd9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Volume volume-42c8df1b-ce09-4e9d-b315-f1ada664539f (42c8df1b-ce09-4e9d-b315-f1ada664539f): created successfully
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e664be3b-3161-447e-801d-137b543cd9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Flow 'volume_create_manager' (2fddb893-9226-4a18-a4b4-0058cb7a3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5dc05de7-f1b0-4375-8119-cb283fc2ca82 tempest-AttachVolumeNegativeTest-2076455395 None] Created volume successfully.
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (9e5329dc-9836-4687-b590-738295816680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d68a287-92db-45c3-909c-11d350840215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d68a287-92db-45c3-909c-11d350840215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1326824930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a112ca0-6881-4e14-bb11-590e9f781047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:21Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1adf43e4-d14c-485f-97f3-457413486dca),volume_type_id=1adf43e4-d14c-485f-97f3-457413486dca)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9876b745-b02b-44dd-b7ea-554c8d5729aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9876b745-b02b-44dd-b7ea-554c8d5729aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b169efa4-be7a-487a-860a-e67fb88b797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b169efa4-be7a-487a-860a-e67fb88b797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a112ca0-6881-4e14-bb11-590e9f781047', 'volume_name': 'volume-5a112ca0-6881-4e14-bb11-590e9f781047', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90aef44d-5282-4792-bee6-c866510c48df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90aef44d-5282-4792-bee6-c866510c48df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2dee07-59ac-48e5-a06d-dd8e7d9c872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume 5a112ca0-6881-4e14-bb11-590e9f781047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a112ca0-6881-4e14-bb11-590e9f781047', 'volume_size': 1}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1326824930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a112ca0-6881-4e14-bb11-590e9f781047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:21Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1adf43e4-d14c-485f-97f3-457413486dca),volume_type_id=1adf43e4-d14c-485f-97f3-457413486dca)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Creating volume 5a112ca0-6881-4e14-bb11-590e9f781047 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:14:20 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:14:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:20 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 1073741824
Jun 17 04:14:20 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (b6ff3838-cb1e-44c1-87e7-1914176655d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084dedb-e397-4278-9f15-1a171359404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084dedb-e397-4278-9f15-1a171359404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955042790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea670ab-55ec-48ea-89fd-b47a55e94ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:21Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(960a5a0e-d4e5-4b90-8ee4-f2e9067d4c90),volume_type_id=960a5a0e-d4e5-4b90-8ee4-f2e9067d4c90)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96083e9b-7c90-438c-a7a4-0a28edf01dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96083e9b-7c90-438c-a7a4-0a28edf01dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688db5bc-4a20-47c3-87e1-52a7fc008698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688db5bc-4a20-47c3-87e1-52a7fc008698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea670ab-55ec-48ea-89fd-b47a55e94ee3', 'volume_name': 'volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73366298-3438-4ccc-b7d9-647aad6b72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73366298-3438-4ccc-b7d9-647aad6b72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b6be99-8ed7-45b6-8910-83cf48533490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume 3ea670ab-55ec-48ea-89fd-b47a55e94ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3', 'volume_size': 1}
Jun 17 04:14:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:22 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 1073741824" returned: 0 in 1.132s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:22 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047
Jun 17 04:14:22 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (8163862b-bdee-48f5-b101-de7d7d4b5604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896c251f-b635-43e0-933a-5904d09c452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896c251f-b635-43e0-933a-5904d09c452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1304565070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4dd51-4f17-43d9-961f-6d8ef0752efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:22Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef751d5b-4711-4c38-9df9-3bfad77d28ab),volume_type_id=ef751d5b-4711-4c38-9df9-3bfad77d28ab)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb020dcd-1d82-465e-aed5-d2c1cf26c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb020dcd-1d82-465e-aed5-d2c1cf26c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d367c5-c4cb-486f-b752-1e21141cec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d367c5-c4cb-486f-b752-1e21141cec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bae4dd51-4f17-43d9-961f-6d8ef0752efc', 'volume_name': 'volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc', 'volume_size': 1, 'image_id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1144705957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6307b876f8b347acb3827efa563348b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'created_at': datetime.datetime(2026, 6, 17, 2, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b4a1af0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e086888-dc07-4f19-9aeb-15512a6d0315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e086888-dc07-4f19-9aeb-15512a6d0315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484a9b5a-c828-43b3-b006-1fbfa1732134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume bae4dd51-4f17-43d9-961f-6d8ef0752efc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc', 'volume_size': 1, 'image_id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1144705957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6307b876f8b347acb3827efa563348b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'created_at': datetime.datetime(2026, 6, 17, 2, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b4a1af0>}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Trying to clone bae4dd51-4f17-43d9-961f-6d8ef0752efc from image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:14:22 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047" returned: 0 in 0.697s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955042790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea670ab-55ec-48ea-89fd-b47a55e94ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:21Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(960a5a0e-d4e5-4b90-8ee4-f2e9067d4c90),volume_type_id=960a5a0e-d4e5-4b90-8ee4-f2e9067d4c90)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Creating volume 3ea670ab-55ec-48ea-89fd-b47a55e94ee3 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:14:22 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:22 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 1073741824
Jun 17 04:14:22 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2dee07-59ac-48e5-a06d-dd8e7d9c872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a112ca0-6881-4e14-bb11-590e9f781047', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f424c56-9093-4f71-b311-33ab82f0e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume volume-5a112ca0-6881-4e14-bb11-590e9f781047 (5a112ca0-6881-4e14-bb11-590e9f781047): created successfully
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f424c56-9093-4f71-b311-33ab82f0e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (9e5329dc-9836-4687-b590-738295816680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4813480d-bc34-438b-8ab7-9dfa54078889 tempest-TestInstancesWithCinderVolumes-266447307 None] Created volume successfully.
Jun 17 04:14:23 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 1073741824" returned: 0 in 0.979s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:23 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3
Jun 17 04:14:23 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:24 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" returned: 0 in 0.593s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.164s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b6be99-8ed7-45b6-8910-83cf48533490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516b48b-bbe9-494c-ba4f-f096c9ad798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a7771-6d61-403f-8ec7-f13cbeae8900]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:24 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 (3ea670ab-55ec-48ea-89fd-b47a55e94ee3): created successfully
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516b48b-bbe9-494c-ba4f-f096c9ad798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (b6ff3838-cb1e-44c1-87e7-1914176655d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4147d586-c9c2-4628-91c7-893e570b3625 tempest-TestInstancesWithCinderVolumes-266447307 None] Created volume successfully.
Jun 17 04:14:24 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f
Jun 17 04:14:24 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:25 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f" returned: 0 in 0.744s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-42c8df1b-ce09-4e9d-b315-f1ada664539f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb8e210b-712e-40fe-b8dd-3b4d0fcb0b08', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:14:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-7e6c5c37-3b32-480c-8591-326b02ecf57d req-15c052e0-fb51-4f21-8d2d-f7a78c4b6359 tempest-AttachVolumeNegativeTest-2076455395 None] attachment_update completed successfully.
Jun 17 04:14:26 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD, size 20.69 MB, duration 3.87 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:14:26 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Image download 20.69 MB at 5.35 MB/s
Jun 17 04:14:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa351c-78c6-46b5-b7c9-4b24e6336d13]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:26 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD
Jun 17 04:14:26 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:27 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:27 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Temporary image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 is fetched for user 26be1594ea1e471daddd9baab24dc135. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:14:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b701d-1e23-4e65-b797-ade0d382253f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:27 devstack sudo[105039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD
Jun 17 04:14:27 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:28 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1304565070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4dd51-4f17-43d9-961f-6d8ef0752efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6307b876f8b347acb3827efa563348b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:14:22Z,use_quota=True,user_id='26be1594ea1e471daddd9baab24dc135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef751d5b-4711-4c38-9df9-3bfad77d28ab),volume_type_id=ef751d5b-4711-4c38-9df9-3bfad77d28ab)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Creating volume bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:14:28 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:28 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1073741824
Jun 17 04:14:28 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-f9a0de8a-7c9b-430f-875f-449c8fbd2988 req-c03f20be-7c4a-4743-9d7f-bc4a808ee2c1 tempest-TestMinimumBasicScenario-746423511 None] Terminate volume connection completed successfully.
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f9a0de8a-7c9b-430f-875f-449c8fbd2988 req-c03f20be-7c4a-4743-9d7f-bc4a808ee2c1 tempest-TestMinimumBasicScenario-746423511 None] Deleting attachment f10cc90c-981e-4260-af92-df38ed1ec6d2. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:14:28 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1073741824" returned: 0 in 0.817s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:28 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:28 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:29 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 0.588s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Attempting download of 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 ((None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}])) to volume bae4dd51-4f17-43d9-961f-6d8ef0752efc. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe4041-015a-4166-b3c6-53b31920a99f]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:29 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh
Jun 17 04:14:29 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:30 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh" returned: 0 in 0.711s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:30 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh
Jun 17 04:14:30 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "cinder-452f311f-12ab-4840-a3a3-6eac85453ea8-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "cinder-452f311f-12ab-4840-a3a3-6eac85453ea8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "cinder-quobyte-452f311f-12ab-4840-a3a3-6eac85453ea8" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "cinder-quobyte-452f311f-12ab-4840-a3a3-6eac85453ea8" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6fc279-f9db-4a71-bf8e-738a4af621ad]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:30 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8
Jun 17 04:14:30 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:31 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh" returned: 1 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_sddcnhuh' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0801db-3fe0-4e8f-a825-971d44344a6a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-776a9c05-d1f3-42af-87de-e027f9b086dd req-82f09394-4207-48ef-aecd-ef7ce227502c tempest-AttachVolumeNegativeTest-2076455395 None] Terminate volume connection completed successfully.
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-776a9c05-d1f3-42af-87de-e027f9b086dd req-82f09394-4207-48ef-aecd-ef7ce227502c tempest-AttachVolumeNegativeTest-2076455395 None] Deleting attachment bb8e210b-712e-40fe-b8dd-3b4d0fcb0b08. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:14:31 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD
Jun 17 04:14:31 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:31 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:31 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8
Jun 17 04:14:31 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:31 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 was qcow2, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:14:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:31 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:31 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:32 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-452f311f-12ab-4840-a3a3-6eac85453ea8" returned: 0 in 0.620s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "cinder-quobyte-452f311f-12ab-4840-a3a3-6eac85453ea8" released by "delete_volume" :: held 1.415s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Created reservations ['b4237f8e-9a41-4620-b888-73d8418f0752', '7e159e44-aa92-4e4a-bbca-94d451e16f43', 'f49deeba-3a96-4f21-90c0-9ff6d5c7908d', '74a7970e-bd57-47c1-8276-a3dfc36ce978'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:32 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:14:32 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:32 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:14:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Deleted volume successfully.
Jun 17 04:14:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-52d163f7-15e9-473c-8d47-354132aec765 tempest-TestMinimumBasicScenario-746423511 None] Lock "cinder-452f311f-12ab-4840-a3a3-6eac85453ea8-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:34 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 2.445s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:34 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63_a475w87idevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:14:34 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Converted 112.00 MB image at 45.80 MB/s
Jun 17 04:14:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:34 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1G
Jun 17 04:14:34 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:35 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc 1G" returned: 0 in 1.098s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09404d-0356-4277-b83e-3f801caad9f8]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:35 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:35 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:36 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 0.770s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:36 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:36 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:36 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 1 in 0.806s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Downloaded image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 ((None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}])) to volume bae4dd51-4f17-43d9-961f-6d8ef0752efc successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Temporary image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 for user 26be1594ea1e471daddd9baab24dc135 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Marking volume bae4dd51-4f17-43d9-961f-6d8ef0752efc as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Copying metadata from image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 to bae4dd51-4f17-43d9-961f-6d8ef0752efc. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:14:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Creating volume glance metadata for volume bae4dd51-4f17-43d9-961f-6d8ef0752efc backed by image 53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63 with: {'image_id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'image_name': 'tempest-scenario-img--1144705957', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:14:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484a9b5a-c828-43b3-b006-1fbfa1732134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc', 'volume_size': 1, 'image_id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1144705957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6307b876f8b347acb3827efa563348b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63', 'created_at': datetime.datetime(2026, 6, 17, 2, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53d8bb04-cd5a-4559-a9b1-98e1d8c9ba63/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b4a1af0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c231b30e-e7d6-408e-b6e3-e26e6cb4b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:14:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Volume volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc (bae4dd51-4f17-43d9-961f-6d8ef0752efc): created successfully
Jun 17 04:14:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c231b30e-e7d6-408e-b6e3-e26e6cb4b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:14:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Flow 'volume_create_manager' (8163862b-bdee-48f5-b101-de7d7d4b5604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:14:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4ec0f18b-9a39-4515-9b5a-629d10d72604 tempest-TestInstancesWithCinderVolumes-266447307 None] Created volume successfully.
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-42c8df1b-ce09-4e9d-b315-f1ada664539f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-42c8df1b-ce09-4e9d-b315-f1ada664539f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-quobyte-42c8df1b-ce09-4e9d-b315-f1ada664539f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-42c8df1b-ce09-4e9d-b315-f1ada664539f" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb23de7-0d6d-4232-a453-c3ea1f8c4941]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:42 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f
Jun 17 04:14:42 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:42 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:42 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f
Jun 17 04:14:42 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:43 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-42c8df1b-ce09-4e9d-b315-f1ada664539f" returned: 0 in 0.744s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-42c8df1b-ce09-4e9d-b315-f1ada664539f" released by "delete_volume" :: held 1.572s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Created reservations ['8f6fa5a2-55c8-469c-aa45-d5ad4a9e72f9', 'cac61b7f-0d79-453f-89df-ef67329ab5cf', 'b063fc48-7c29-4ca2-8ce0-74226399b578', '4adbade1-e65d-4012-b2da-abf3ac51a5e9'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:43 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:14:43 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-e61664fe-a23c-4f8e-8dc1-4dadc855c288-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-e61664fe-a23c-4f8e-8dc1-4dadc855c288-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-quobyte-e61664fe-a23c-4f8e-8dc1-4dadc855c288" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-e61664fe-a23c-4f8e-8dc1-4dadc855c288" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84ed51-382b-4d6a-84c1-f0cf0ae4ad5e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:44 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.803s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:14:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Deleted volume successfully.
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-17722cfd-690c-4831-8ce0-43de0d4c1767 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-42c8df1b-ce09-4e9d-b315-f1ada664539f-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:44 devstack sudo[105227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288
Jun 17 04:14:44 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf6ae0-5b57-4a3f-ad89-b43366af3cfc]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:44 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:44 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:45 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288" returned: 0 in 0.871s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:45 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288
Jun 17 04:14:45 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:45 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 0.829s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:45 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:14:45 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:46 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e61664fe-a23c-4f8e-8dc1-4dadc855c288" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-e61664fe-a23c-4f8e-8dc1-4dadc855c288" released by "delete_volume" :: held 1.632s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Created reservations ['0cd6f49e-c6f0-4c7a-b048-11ffce373108', 'e0d3dcf3-ef40-4d86-8bd1-803dfb41ca83', 'f2f54b0a-abd8-4a8d-97aa-2a0195a04f93', 'e0063fed-a39f-4002-aaa7-17321ae88a85'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:46 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:14:46 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:46 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 1 in 0.732s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.613s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fea4c1a1-1832-4f6d-8a1e-946dcad09467', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:14:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-4e81f03c-24fb-4537-bdfe-83ed5a07c115 req-58709f2a-ff8a-46d5-a58e-2bd30244db5f tempest-TestInstancesWithCinderVolumes-266447307 None] attachment_update completed successfully.
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-8d91f335-660b-466b-a383-5657575c5863-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-8d91f335-660b-466b-a383-5657575c5863-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:47 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "cinder-quobyte-8d91f335-660b-466b-a383-5657575c5863" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.828s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:14:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Deleted volume successfully.
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-8d91f335-660b-466b-a383-5657575c5863" acquired by "delete_volume" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c690dee2-b961-4281-a5f2-afb162294882 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-e61664fe-a23c-4f8e-8dc1-4dadc855c288-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfab781-1f8d-4547-ab85-330796245460]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:47 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863
Jun 17 04:14:47 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:47 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863" returned: 0 in 0.813s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:47 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863
Jun 17 04:14:47 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:48 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8d91f335-660b-466b-a383-5657575c5863" returned: 0 in 0.652s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-quobyte-8d91f335-660b-466b-a383-5657575c5863" released by "delete_volume" :: held 1.535s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Created reservations ['c5da063c-a51e-4687-a69b-a01ea7d3e964', '308a347d-3725-4233-8589-a8e741f722d6', '422b67d4-1673-4f1c-9059-aa9acb59cf2b', '9ff23d15-9abc-4f1d-8805-90bc1e144237'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:14:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:14:48 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:14:48 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:14:49 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jun 17 04:14:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.642s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:14:49 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:14:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Deleted volume successfully.
Jun 17 04:14:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fe773a47-b351-4042-a9e0-b2d70ccbcc99 tempest-AttachVolumeNegativeTest-2076455395 None] Lock "cinder-8d91f335-660b-466b-a383-5657575c5863-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:14:58 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=57,cinder:INSERT=12,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:14:59 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=47,cinder:SELECT=36,cinder:DELETE=5,cinder:INSERT=17 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:15:00 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Flow 'volume_create_manager' (ab914724-126c-4bae-b238-e66f585668ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863efaba-8fac-4133-979f-845dd57126f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863efaba-8fac-4133-979f-845dd57126f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-851272211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7396be38-c30d-457e-ac60-d8d326b47ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cb9f2c2b0e4c1d8d530b27148c7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:01Z,use_quota=True,user_id='c152ca70b68144a7824d5d4790ad3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cfbce-f425-4e05-8059-95bfb7c6ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cfbce-f425-4e05-8059-95bfb7c6ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36599fd2-c3af-41d8-9e07-11875620d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36599fd2-c3af-41d8-9e07-11875620d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7396be38-c30d-457e-ac60-d8d326b47ab7', 'volume_name': 'volume-7396be38-c30d-457e-ac60-d8d326b47ab7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44894f-a332-4066-83be-21abc2f385e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44894f-a332-4066-83be-21abc2f385e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9881a9-6ee5-489d-bb32-c070be1897de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:01 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume 7396be38-c30d-457e-ac60-d8d326b47ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7396be38-c30d-457e-ac60-d8d326b47ab7', 'volume_size': 1}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-851272211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7396be38-c30d-457e-ac60-d8d326b47ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cb9f2c2b0e4c1d8d530b27148c7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:01Z,use_quota=True,user_id='c152ca70b68144a7824d5d4790ad3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Creating volume 7396be38-c30d-457e-ac60-d8d326b47ab7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:01 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:01 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 1073741824
Jun 17 04:15:01 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:02 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:02 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:02 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 1073741824" returned: 0 in 1.245s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:02 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7
Jun 17 04:15:02 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:03 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7" returned: 0 in 0.912s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9881a9-6ee5-489d-bb32-c070be1897de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7396be38-c30d-457e-ac60-d8d326b47ab7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d228fda-afe3-4f26-a5e1-80b42926621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:03 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume volume-7396be38-c30d-457e-ac60-d8d326b47ab7 (7396be38-c30d-457e-ac60-d8d326b47ab7): created successfully
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d228fda-afe3-4f26-a5e1-80b42926621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Flow 'volume_create_manager' (ab914724-126c-4bae-b238-e66f585668ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2d2942ac-876d-4fde-bd4d-5189815ece50 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Created volume successfully.
Jun 17 04:15:03 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.434s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:15:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "cinder-7396be38-c30d-457e-ac60-d8d326b47ab7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "cinder-7396be38-c30d-457e-ac60-d8d326b47ab7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "cinder-quobyte-7396be38-c30d-457e-ac60-d8d326b47ab7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "cinder-quobyte-7396be38-c30d-457e-ac60-d8d326b47ab7" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d32a0b-ac0f-440a-b16d-19da8efb1b3a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:04 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7
Jun 17 04:15:04 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:05 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7" returned: 0 in 0.837s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:05 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7
Jun 17 04:15:05 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:06 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7396be38-c30d-457e-ac60-d8d326b47ab7" returned: 0 in 0.853s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "cinder-quobyte-7396be38-c30d-457e-ac60-d8d326b47ab7" released by "delete_volume" :: held 1.760s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Created reservations ['eecc90ee-b80f-4ddc-abf8-026a66ee69b9', 'e5eccee2-220a-47ee-9301-c3099f4eef61', 'ff1f41ad-bf9d-43c1-a0dd-d2c6dc4fcc19', 'd869c8ec-8dd3-4b15-a061-961f035241af'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:06 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:06 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:07 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.821s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Deleted volume successfully.
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bc4f1433-dbf7-4ec2-8da3-94e3471fb8e4 tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "cinder-7396be38-c30d-457e-ac60-d8d326b47ab7-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Flow 'volume_create_manager' (919aaa7f-02e6-4f99-9c0f-197099e0fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb52f8a-4d49-4d9b-98d9-415a7d0c23f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb52f8a-4d49-4d9b-98d9-415a7d0c23f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-661455722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e378af15-6410-460d-adc1-dd33390e45b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cb9f2c2b0e4c1d8d530b27148c7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:07Z,use_quota=True,user_id='c152ca70b68144a7824d5d4790ad3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676c2470-3ae5-4ad6-bdc1-3ef52d03e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676c2470-3ae5-4ad6-bdc1-3ef52d03e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe57bcd-3aea-452f-bd73-1cef23cc19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe57bcd-3aea-452f-bd73-1cef23cc19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e378af15-6410-460d-adc1-dd33390e45b6', 'volume_name': 'volume-e378af15-6410-460d-adc1-dd33390e45b6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c824eaa4-bfaf-43a1-b1a8-f5b3690f3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c824eaa4-bfaf-43a1-b1a8-f5b3690f3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8ad18-4fc5-4fd2-aab5-3e6d9feeb327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:07 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume e378af15-6410-460d-adc1-dd33390e45b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e378af15-6410-460d-adc1-dd33390e45b6', 'volume_size': 1}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-661455722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e378af15-6410-460d-adc1-dd33390e45b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cb9f2c2b0e4c1d8d530b27148c7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:07Z,use_quota=True,user_id='c152ca70b68144a7824d5d4790ad3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Creating volume e378af15-6410-460d-adc1-dd33390e45b6 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:07 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:07 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 1073741824
Jun 17 04:15:07 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:08 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 1073741824" returned: 0 in 0.916s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:08 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6
Jun 17 04:15:08 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:09 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6" returned: 0 in 0.757s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8ad18-4fc5-4fd2-aab5-3e6d9feeb327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e378af15-6410-460d-adc1-dd33390e45b6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f943a217-bfae-491e-b9c0-f6d2d860491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:09 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Volume volume-e378af15-6410-460d-adc1-dd33390e45b6 (e378af15-6410-460d-adc1-dd33390e45b6): created successfully
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f943a217-bfae-491e-b9c0-f6d2d860491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Flow 'volume_create_manager' (919aaa7f-02e6-4f99-9c0f-197099e0fe76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-36aee010-ecb9-481a-be13-9aefe8ff8ddb tempest-VolumeQuotasAdminTestJSON-1449942543 None] Created volume successfully.
Jun 17 04:15:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-67692ffb-739f-4281-bbdf-57177a16979a tempest-VolumeQuotasAdminTestJSON-1277548661 None] Transfer volume completed successfully.
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Acquiring lock "cinder-e378af15-6410-460d-adc1-dd33390e45b6-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "cinder-e378af15-6410-460d-adc1-dd33390e45b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Acquiring lock "cinder-quobyte-e378af15-6410-460d-adc1-dd33390e45b6" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "cinder-quobyte-e378af15-6410-460d-adc1-dd33390e45b6" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[21263acd-abc8-4962-8ed5-901c63287274]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:11 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6
Jun 17 04:15:11 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:12 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6" returned: 0 in 0.858s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:12 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6
Jun 17 04:15:12 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:12 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e378af15-6410-460d-adc1-dd33390e45b6" returned: 0 in 0.625s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "cinder-quobyte-e378af15-6410-460d-adc1-dd33390e45b6" released by "delete_volume" :: held 1.526s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Created reservations ['f6cbbe76-ca31-4233-9543-79950d344c9c', '63539c46-ce46-4b14-88ef-62b3cb15ad9c', '0582d96a-13e8-4a2f-a414-e1cb09e143d1', 'b6e10d13-d1e7-46e1-8c62-275cea93c64c'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:12 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:12 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:13 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.677s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:13 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Deleted volume successfully.
Jun 17 04:15:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2a01cca7-6580-448a-8166-2c8f92c784d9 tempest-VolumeQuotasAdminTestJSON-1407394149 None] Lock "cinder-e378af15-6410-460d-adc1-dd33390e45b6-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:22 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=12 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:15:23 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=18,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Flow 'volume_create_manager' (61a848a8-392c-4e09-be0b-360fc6bb0097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd098aa-cf99-4a63-9a53-0673970af12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd098aa-cf99-4a63-9a53-0673970af12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-281044218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e465fffe-a2ba-477b-b149-b4667a3267aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476568c42ace400e83c494af7a86e9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:26Z,use_quota=True,user_id='477f9c7b5d0b4e33b874ffe9271f06ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a0ca7-2a50-40c1-8dc5-d5af37ea704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a0ca7-2a50-40c1-8dc5-d5af37ea704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d74ea5-4815-46d1-bdb0-2166c0c83d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d74ea5-4815-46d1-bdb0-2166c0c83d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e465fffe-a2ba-477b-b149-b4667a3267aa', 'volume_name': 'volume-e465fffe-a2ba-477b-b149-b4667a3267aa', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84d580b-2c2d-4a1d-8ab3-7d8daf035a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84d580b-2c2d-4a1d-8ab3-7d8daf035a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167b1088-fee1-4478-a7b3-6aa65f5d64c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Volume e465fffe-a2ba-477b-b149-b4667a3267aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e465fffe-a2ba-477b-b149-b4667a3267aa', 'volume_size': 1}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-281044218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e465fffe-a2ba-477b-b149-b4667a3267aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476568c42ace400e83c494af7a86e9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:26Z,use_quota=True,user_id='477f9c7b5d0b4e33b874ffe9271f06ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Creating volume e465fffe-a2ba-477b-b149-b4667a3267aa {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:26 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:26 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa 1073741824
Jun 17 04:15:26 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:27 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa 1073741824" returned: 0 in 0.863s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:27 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa
Jun 17 04:15:27 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:28 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa" returned: 0 in 0.582s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167b1088-fee1-4478-a7b3-6aa65f5d64c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e465fffe-a2ba-477b-b149-b4667a3267aa', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1145b3e3-dcc4-4fea-8a99-2d407576b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8447d-0059-4b28-bcc1-abde968bbb02]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Volume volume-e465fffe-a2ba-477b-b149-b4667a3267aa (e465fffe-a2ba-477b-b149-b4667a3267aa): created successfully
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1145b3e3-dcc4-4fea-8a99-2d407576b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Flow 'volume_create_manager' (61a848a8-392c-4e09-be0b-360fc6bb0097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-53dcbd49-3918-49ef-8fa3-4da82e9b4523 tempest-VolumesMetadataTest-1901327999 None] Created volume successfully.
Jun 17 04:15:28 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047
Jun 17 04:15:28 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:28 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047" returned: 0 in 0.718s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.749s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-5a112ca0-6881-4e14-bb11-590e9f781047', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '690a8b96-3750-4c10-838f-1a1d566f0888', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:15:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-271da8bb-676a-4f4b-8f11-9143ac066f6b req-50cceb92-ec80-4100-85fb-386b3843c589 tempest-TestInstancesWithCinderVolumes-266447307 None] attachment_update completed successfully.
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Acquiring lock "cinder-e465fffe-a2ba-477b-b149-b4667a3267aa-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "cinder-e465fffe-a2ba-477b-b149-b4667a3267aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Acquiring lock "cinder-quobyte-e465fffe-a2ba-477b-b149-b4667a3267aa" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "cinder-quobyte-e465fffe-a2ba-477b-b149-b4667a3267aa" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3393c4-2554-41b4-b418-e4b508563718]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:29 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa
Jun 17 04:15:29 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:30 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa" returned: 0 in 0.751s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:30 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa
Jun 17 04:15:30 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:30 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-e465fffe-a2ba-477b-b149-b4667a3267aa" returned: 0 in 0.594s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "cinder-quobyte-e465fffe-a2ba-477b-b149-b4667a3267aa" released by "delete_volume" :: held 1.384s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Created reservations ['3dc5fe6d-9758-40f1-81e3-a29c9461947e', '89776931-1fc9-4774-ab4d-46f66163e912', 'b3a949dc-489b-464e-b454-d6776e0d6623', 'b9a61ed6-03f7-422c-afff-4b723e1f844a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:30 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:30 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:31 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:31 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Deleted volume successfully.
Jun 17 04:15:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7d5b5539-c4e4-43b1-81f5-4f026af3ff1d tempest-VolumesMetadataTest-1901327999 None] Lock "cinder-e465fffe-a2ba-477b-b149-b4667a3267aa-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Flow 'volume_create_manager' (a7e8bbbc-8b42-45e2-9536-7ead92514cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d2c195-5afc-4ac6-b57a-a7f2c10fd85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d2c195-5afc-4ac6-b57a-a7f2c10fd85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-184478279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900bf69d-90c5-4381-85d7-8d13eae1097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d45e76a686c49fe9d7141b08ff1348a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:37Z,use_quota=True,user_id='109788ee03e24d49a8e6f72206d95abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3ca27-6095-418c-9059-0df0b9453f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3ca27-6095-418c-9059-0df0b9453f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e31719-8ac3-4b26-a092-cdbe0ac88c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e31719-8ac3-4b26-a092-cdbe0ac88c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900bf69d-90c5-4381-85d7-8d13eae1097c', 'volume_name': 'volume-900bf69d-90c5-4381-85d7-8d13eae1097c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409c8d35-5caf-4edb-9d8b-a70863a905cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409c8d35-5caf-4edb-9d8b-a70863a905cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf76d4f6-1921-4e63-bc2c-707efe1e6e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Volume 900bf69d-90c5-4381-85d7-8d13eae1097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900bf69d-90c5-4381-85d7-8d13eae1097c', 'volume_size': 1}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-184478279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900bf69d-90c5-4381-85d7-8d13eae1097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d45e76a686c49fe9d7141b08ff1348a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:37Z,use_quota=True,user_id='109788ee03e24d49a8e6f72206d95abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Creating volume 900bf69d-90c5-4381-85d7-8d13eae1097c {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:36 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:36 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c 1073741824
Jun 17 04:15:36 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:37 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c 1073741824" returned: 0 in 0.816s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:37 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c
Jun 17 04:15:37 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:38 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c" returned: 0 in 0.606s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.426s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf76d4f6-1921-4e63-bc2c-707efe1e6e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900bf69d-90c5-4381-85d7-8d13eae1097c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ad4f24-7c46-4a53-b045-08937df29422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e01a18-a892-44de-bd7d-c57f17281be5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:38 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Volume volume-900bf69d-90c5-4381-85d7-8d13eae1097c (900bf69d-90c5-4381-85d7-8d13eae1097c): created successfully
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ad4f24-7c46-4a53-b045-08937df29422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Flow 'volume_create_manager' (a7e8bbbc-8b42-45e2-9536-7ead92514cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f4261ce4-0830-4464-b656-7f67b514004f tempest-VolumesTransfersTest-164759628 None] Created volume successfully.
Jun 17 04:15:38 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3
Jun 17 04:15:38 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:39 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" returned: 0 in 0.733s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b151574-b139-4d32-9de9-e2e7d441e226', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:15:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-df3e23ea-152d-4b73-aa61-c0346f757bc6 req-e897e0ef-3c9a-4d01-8b37-9b1716b02db7 tempest-TestInstancesWithCinderVolumes-266447307 None] attachment_update completed successfully.
Jun 17 04:15:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dc3ec505-10fb-4c20-90e3-c849a5deaa19 tempest-VolumesTransfersTest-370545502 None] Transfer volume completed successfully.
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Acquiring lock "cinder-900bf69d-90c5-4381-85d7-8d13eae1097c-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "cinder-900bf69d-90c5-4381-85d7-8d13eae1097c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Acquiring lock "cinder-quobyte-900bf69d-90c5-4381-85d7-8d13eae1097c" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "cinder-quobyte-900bf69d-90c5-4381-85d7-8d13eae1097c" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4909a9-ec35-42f7-a957-05e01299cec3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:40 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c
Jun 17 04:15:40 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:41 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c" returned: 0 in 0.711s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:41 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c
Jun 17 04:15:41 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:41 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-900bf69d-90c5-4381-85d7-8d13eae1097c" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "cinder-quobyte-900bf69d-90c5-4381-85d7-8d13eae1097c" released by "delete_volume" :: held 1.351s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Created reservations ['19c439a8-f8b4-414a-881b-0f038d8add2e', '3b7f3636-f34e-45b9-af08-fd5cb35aa7fe', '92d1e0a6-4bfd-4bdc-b55e-182fa2674ec7', '9c10eb3c-759c-438e-a505-a91114ee2bf3'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:41 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:41 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:42 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Deleted volume successfully.
Jun 17 04:15:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c22fd107-e018-4b7f-8cec-db19934faf9f tempest-VolumesTransfersTest-561205922 None] Lock "cinder-900bf69d-90c5-4381-85d7-8d13eae1097c-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Flow 'volume_create_manager' (220d6020-b015-4fb8-ac6f-f98ab84ac511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9aaaa0-a571-4654-9c03-7a4de0586eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9aaaa0-a571-4654-9c03-7a4de0586eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-520027349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8117de0b-41da-49e1-ab10-3fb6ecadf566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d45e76a686c49fe9d7141b08ff1348a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:43Z,use_quota=True,user_id='109788ee03e24d49a8e6f72206d95abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cfbdec-d683-4aea-88ac-7796f6d852b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cfbdec-d683-4aea-88ac-7796f6d852b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879b4c3-a9ef-45a6-812c-b95eaa253380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879b4c3-a9ef-45a6-812c-b95eaa253380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8117de0b-41da-49e1-ab10-3fb6ecadf566', 'volume_name': 'volume-8117de0b-41da-49e1-ab10-3fb6ecadf566', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b149825-21fa-4660-b8d3-a26689bdbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b149825-21fa-4660-b8d3-a26689bdbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee1027f-14a0-4eb5-b68f-3b618fb007b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:43 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Volume 8117de0b-41da-49e1-ab10-3fb6ecadf566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8117de0b-41da-49e1-ab10-3fb6ecadf566', 'volume_size': 1}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-520027349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8117de0b-41da-49e1-ab10-3fb6ecadf566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d45e76a686c49fe9d7141b08ff1348a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:43Z,use_quota=True,user_id='109788ee03e24d49a8e6f72206d95abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Creating volume 8117de0b-41da-49e1-ab10-3fb6ecadf566 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:43 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:43 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 1073741824
Jun 17 04:15:43 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:44 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 1073741824" returned: 0 in 0.858s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:44 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566
Jun 17 04:15:44 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:44 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee1027f-14a0-4eb5-b68f-3b618fb007b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8117de0b-41da-49e1-ab10-3fb6ecadf566', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9452819-e3f9-4d8c-be53-998e169d6427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:44 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Volume volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 (8117de0b-41da-49e1-ab10-3fb6ecadf566): created successfully
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9452819-e3f9-4d8c-be53-998e169d6427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Flow 'volume_create_manager' (220d6020-b015-4fb8-ac6f-f98ab84ac511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b3884799-f525-4f11-97be-f9ebbcba0724 tempest-VolumesTransfersTest-164759628 None] Created volume successfully.
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Acquiring lock "cinder-8117de0b-41da-49e1-ab10-3fb6ecadf566-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "cinder-8117de0b-41da-49e1-ab10-3fb6ecadf566-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Acquiring lock "cinder-quobyte-8117de0b-41da-49e1-ab10-3fb6ecadf566" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "cinder-quobyte-8117de0b-41da-49e1-ab10-3fb6ecadf566" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0fb33-cc86-4ba6-bb63-84d6f9f7b10a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:45 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566
Jun 17 04:15:45 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:46 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:46 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566
Jun 17 04:15:46 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:46 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8117de0b-41da-49e1-ab10-3fb6ecadf566" returned: 0 in 0.582s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "cinder-quobyte-8117de0b-41da-49e1-ab10-3fb6ecadf566" released by "delete_volume" :: held 1.315s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Created reservations ['8af5fbf8-97f7-41c4-b643-2704a1bbf554', '8a4d3406-ad20-469d-bbcb-4d7037773e4f', 'cd57b9c9-b0fb-4eb4-8e65-f01299b16096', '9a131a08-69cc-45f2-b0c8-d71cf0638c25'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:47 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:47 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-7ba97849-b080-49f5-b84b-315c3ab97180 req-3e029ddc-95dc-4b17-8ccc-bd413d1eeb23 tempest-TestInstancesWithCinderVolumes-266447307 None] Terminate volume connection completed successfully.
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-7ba97849-b080-49f5-b84b-315c3ab97180 req-3e029ddc-95dc-4b17-8ccc-bd413d1eeb23 tempest-TestInstancesWithCinderVolumes-266447307 None] Deleting attachment 690a8b96-3750-4c10-838f-1a1d566f0888. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:15:47 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Deleted volume successfully.
Jun 17 04:15:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-50a2939a-cfcf-4d69-80a5-e9624b8cfaa0 tempest-VolumesTransfersTest-561205922 None] Lock "cinder-8117de0b-41da-49e1-ab10-3fb6ecadf566-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-5a112ca0-6881-4e14-bb11-590e9f781047-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-5a112ca0-6881-4e14-bb11-590e9f781047-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-quobyte-5a112ca0-6881-4e14-bb11-590e9f781047" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-5a112ca0-6881-4e14-bb11-590e9f781047" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf456e16-da1f-491c-9b26-6e794e380c7a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:49 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047
Jun 17 04:15:49 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:50 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047" returned: 0 in 0.813s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:50 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047
Jun 17 04:15:50 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:51 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a112ca0-6881-4e14-bb11-590e9f781047" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-5a112ca0-6881-4e14-bb11-590e9f781047" released by "delete_volume" :: held 1.542s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:51 devstack cinder-volume[92204]: WARNING cinder.quota [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823488124-1808183835 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823488124-1808183835, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:15:51 devstack cinder-volume[92204]: WARNING cinder.quota [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823488124-1808183835 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823488124-1808183835, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Created reservations ['b7131143-edb9-4e89-83a1-b3d21bd83e4a', '31b37d37-e107-4ba5-aa46-219bda1f2b9f', '45044841-3e58-4722-b494-514961927834', '60c3f239-d957-40ac-9de5-e095a1472178'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:51 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:51 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:51 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.664s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Deleted volume successfully.
Jun 17 04:15:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f52e1853-656d-460e-8faf-20858fab2adf tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-5a112ca0-6881-4e14-bb11-590e9f781047-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-ec92601a-b8ba-4a29-935f-36b8db59575b req-cbbdd000-b5a7-47fa-926a-d970872135f8 tempest-TestInstancesWithCinderVolumes-266447307 None] Terminate volume connection completed successfully.
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-ec92601a-b8ba-4a29-935f-36b8db59575b req-cbbdd000-b5a7-47fa-926a-d970872135f8 tempest-TestInstancesWithCinderVolumes-266447307 None] Deleting attachment 7b151574-b139-4d32-9de9-e2e7d441e226. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Flow 'volume_create_manager' (afd3f1c4-2b7d-4556-81d4-6157e52d5e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9607bc8-b690-47d9-9f5f-20357a6b96cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9607bc8-b690-47d9-9f5f-20357a6b96cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-769303915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a03385c-005f-415d-af4f-2e858b0fbe0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fff71723b3470186e086fa19bfc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:55Z,use_quota=True,user_id='7ee7cfa8790e4ea5ae430426f0f80c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a426a41-52c0-41ff-90d9-3426fc483bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a426a41-52c0-41ff-90d9-3426fc483bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00d2586-e65f-43cd-b9d8-c1b9b3ddb1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00d2586-e65f-43cd-b9d8-c1b9b3ddb1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a03385c-005f-415d-af4f-2e858b0fbe0f', 'volume_name': 'volume-8a03385c-005f-415d-af4f-2e858b0fbe0f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc6c7eb-5654-4a88-8817-999813e52139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc6c7eb-5654-4a88-8817-999813e52139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ac0a46-f8f4-4b62-9b28-709e4b967b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:54 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Volume 8a03385c-005f-415d-af4f-2e858b0fbe0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a03385c-005f-415d-af4f-2e858b0fbe0f', 'volume_size': 1}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-769303915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a03385c-005f-415d-af4f-2e858b0fbe0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fff71723b3470186e086fa19bfc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:55Z,use_quota=True,user_id='7ee7cfa8790e4ea5ae430426f0f80c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Creating volume 8a03385c-005f-415d-af4f-2e858b0fbe0f {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:54 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:54 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f 1073741824
Jun 17 04:15:54 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:55 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f 1073741824" returned: 0 in 0.791s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:55 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f
Jun 17 04:15:55 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:56 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f" returned: 0 in 0.614s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ac0a46-f8f4-4b62-9b28-709e4b967b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a03385c-005f-415d-af4f-2e858b0fbe0f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908627f-0f5b-43b4-95f5-c95e3bd26982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:56 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Volume volume-8a03385c-005f-415d-af4f-2e858b0fbe0f (8a03385c-005f-415d-af4f-2e858b0fbe0f): created successfully
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908627f-0f5b-43b4-95f5-c95e3bd26982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Flow 'volume_create_manager' (afd3f1c4-2b7d-4556-81d4-6157e52d5e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:56 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fdcb331b-f79c-4af8-89cc-71d01dd18077 tempest-VolumesTransfersV355Test-116935292 None] Created volume successfully.
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-3ea670ab-55ec-48ea-89fd-b47a55e94ee3-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-3ea670ab-55ec-48ea-89fd-b47a55e94ee3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-quobyte-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c8003-2751-4072-a6fe-2ed0b05bec51]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:56 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3
Jun 17 04:15:56 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Flow 'volume_create_manager' (a77f7d7b-5186-482d-b519-ee8bc1da4347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0563da3-cfd8-485e-8687-bca16945a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0563da3-cfd8-485e-8687-bca16945a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1623242684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea2f14-d1c6-4d49-a60d-94e151b86b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0b2ca45c944c97a8bfadf330ef025c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:57Z,use_quota=True,user_id='f344d68c34934e078968309188875448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48598dbe-5860-4fcc-b521-9658dfb207fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48598dbe-5860-4fcc-b521-9658dfb207fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997ac8d7-0c44-498a-b933-99af78ab561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997ac8d7-0c44-498a-b933-99af78ab561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ea2f14-d1c6-4d49-a60d-94e151b86b42', 'volume_name': 'volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d7f9e-8701-4cc3-9b19-db7d12d3d8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d7f9e-8701-4cc3-9b19-db7d12d3d8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a7ea34-0381-45a4-9d88-91ff637268ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Volume 95ea2f14-d1c6-4d49-a60d-94e151b86b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42', 'volume_size': 1}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1623242684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea2f14-d1c6-4d49-a60d-94e151b86b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0b2ca45c944c97a8bfadf330ef025c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:15:57Z,use_quota=True,user_id='f344d68c34934e078968309188875448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Creating volume 95ea2f14-d1c6-4d49-a60d-94e151b86b42 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:15:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:57 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 1073741824
Jun 17 04:15:57 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:57 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" returned: 0 in 0.896s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:57 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3
Jun 17 04:15:57 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f0434a06-d4fc-4de9-badc-fee7a6a951a2 tempest-VolumesTransfersV355Test-284004204 None] Transfer volume completed successfully.
Jun 17 04:15:57 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 1073741824" returned: 0 in 0.936s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:58 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" returned: 0 in 0.711s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:58 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42
Jun 17 04:15:58 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-3ea670ab-55ec-48ea-89fd-b47a55e94ee3" released by "delete_volume" :: held 1.674s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:58 devstack cinder-volume[92204]: WARNING cinder.quota [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534277164-854401018 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534277164-854401018, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:15:58 devstack cinder-volume[92204]: WARNING cinder.quota [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534277164-854401018 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534277164-854401018, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Created reservations ['edd9be2f-5d20-4c7b-a1a4-65f5597ae3f8', '3fad7009-701e-41fe-bc9f-f56e5749fc24', '8eb65fdd-a562-4027-a362-567b167d018a', '5f2f9fe8-b9f2-46a6-beb4-2c43b4a909e9'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:58 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:15:58 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "cinder-8a03385c-005f-415d-af4f-2e858b0fbe0f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-8a03385c-005f-415d-af4f-2e858b0fbe0f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "cinder-quobyte-8a03385c-005f-415d-af4f-2e858b0fbe0f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-quobyte-8a03385c-005f-415d-af4f-2e858b0fbe0f" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbbffcc-48f9-46f5-8bc0-a5a0be330ead]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:15:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:59 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42" returned: 0 in 1.000s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a7ea34-0381-45a4-9d88-91ff637268ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43121333-62e2-4ba4-93bc-9c7bb2faa565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:15:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Volume volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 (95ea2f14-d1c6-4d49-a60d-94e151b86b42): created successfully
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43121333-62e2-4ba4-93bc-9c7bb2faa565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Flow 'volume_create_manager' (a77f7d7b-5186-482d-b519-ee8bc1da4347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:15:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1edc3163-2420-401b-8f77-2279383c6334 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Created volume successfully.
Jun 17 04:15:59 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f
Jun 17 04:15:59 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:15:59 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.940s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:15:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Deleted volume successfully.
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-6c8d099b-6cc6-4391-9e8a-f6964fb56036 tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-3ea670ab-55ec-48ea-89fd-b47a55e94ee3-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:15:59 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f" returned: 0 in 0.828s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:15:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:15:59 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f
Jun 17 04:15:59 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:00 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8a03385c-005f-415d-af4f-2e858b0fbe0f" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-quobyte-8a03385c-005f-415d-af4f-2e858b0fbe0f" released by "delete_volume" :: held 1.660s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Created reservations ['f06b116f-4288-49b1-88d9-1dded6ec955d', '95757016-966b-42a6-b3f5-2a8efe8faa67', 'b20173b3-bfc1-47fa-900e-fe5357fa7157', '3bf8777d-0079-4443-bfc3-e43b830832dd'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:00 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:16:00 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:01 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:16:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Deleted volume successfully.
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ba04da39-46fd-4db5-bfe2-5094c04e4c1d tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-8a03385c-005f-415d-af4f-2e858b0fbe0f-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Flow 'volume_create_manager' (77ca8355-5695-4817-9696-ec5ab73ad5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bafacbd-50d6-4a8e-9a79-a422809d73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bafacbd-50d6-4a8e-9a79-a422809d73d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1347156206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be94c8a-da78-4c76-bbfd-ac9a37bf8280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fff71723b3470186e086fa19bfc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:02Z,use_quota=True,user_id='7ee7cfa8790e4ea5ae430426f0f80c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5751d82-f052-494d-81b4-6d46cbe4169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5751d82-f052-494d-81b4-6d46cbe4169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057519b2-5d74-4f0b-beb4-0303bc9f71e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057519b2-5d74-4f0b-beb4-0303bc9f71e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be94c8a-da78-4c76-bbfd-ac9a37bf8280', 'volume_name': 'volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a66ab7-b8b3-469c-b45f-8f35dcd02567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a66ab7-b8b3-469c-b45f-8f35dcd02567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f9496d-7b49-411e-a95d-36b1645d97c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:01 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Volume 2be94c8a-da78-4c76-bbfd-ac9a37bf8280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280', 'volume_size': 1}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1347156206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be94c8a-da78-4c76-bbfd-ac9a37bf8280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fff71723b3470186e086fa19bfc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:02Z,use_quota=True,user_id='7ee7cfa8790e4ea5ae430426f0f80c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Creating volume 2be94c8a-da78-4c76-bbfd-ac9a37bf8280 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:16:01 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:16:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:01 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 1073741824
Jun 17 04:16:01 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:02 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:16:02 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:02 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 1073741824" returned: 0 in 0.888s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:02 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280
Jun 17 04:16:02 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:02 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:16:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:03 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" returned: 0 in 0.632s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.019s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f9496d-7b49-411e-a95d-36b1645d97c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd03adf3-01b0-4347-9b49-9b7577244c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707b0e7-c33b-47cd-8a9c-6d45713cc34f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:03 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Volume volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 (2be94c8a-da78-4c76-bbfd-ac9a37bf8280): created successfully
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd03adf3-01b0-4347-9b49-9b7577244c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Flow 'volume_create_manager' (77ca8355-5695-4817-9696-ec5ab73ad5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-31eaa369-63c4-4727-8ce7-63bfbb44651c tempest-VolumesTransfersV355Test-116935292 None] Created volume successfully.
Jun 17 04:16:03 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42
Jun 17 04:16:03 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-14f28155-ce27-4116-9a90-aa2c34cdd6c0 req-bdaa2788-e4e8-4b78-8826-ef80b584556b tempest-TestInstancesWithCinderVolumes-266447307 None] Terminate volume connection completed successfully.
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-14f28155-ce27-4116-9a90-aa2c34cdd6c0 req-bdaa2788-e4e8-4b78-8826-ef80b584556b tempest-TestInstancesWithCinderVolumes-266447307 None] Deleting attachment fea4c1a1-1832-4f6d-8a1e-946dcad09467. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:16:03 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42" returned: 0 in 0.718s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.739s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff8d6961-a43d-4bad-97c6-12f701732bab', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:16:04 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-81a0343a-d9e1-4f5d-92c7-7005da9ae292 req-2824dd1c-a95f-4628-8a3e-8e47c4980388 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] attachment_update completed successfully.
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "cinder-2be94c8a-da78-4c76-bbfd-ac9a37bf8280-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-2be94c8a-da78-4c76-bbfd-ac9a37bf8280-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "cinder-quobyte-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-quobyte-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b97ed8-e60c-4d02-a170-f6aab65ce558]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:16:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:04 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280
Jun 17 04:16:04 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:05 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:05 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280
Jun 17 04:16:05 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:05 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-quobyte-2be94c8a-da78-4c76-bbfd-ac9a37bf8280" released by "delete_volume" :: held 1.382s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:05 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Created reservations ['6095f5b9-e859-41e1-b24f-a39da01c88c1', '09b064ad-baca-40e1-8dce-be4289f6dee7', '97e9f6c2-deff-410f-9caa-07581e09cb11', '7275159c-5939-4143-8d1c-1e653cc43abb'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:06 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:16:06 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:06 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:16:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Deleted volume successfully.
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aec8dce5-a0a8-4c23-ab06-7ed7d8c2093c tempest-VolumesTransfersV355Test-2026874919 None] Lock "cinder-2be94c8a-da78-4c76-bbfd-ac9a37bf8280-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-bae4dd51-4f17-43d9-961f-6d8ef0752efc-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-bae4dd51-4f17-43d9-961f-6d8ef0752efc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "cinder-quobyte-bae4dd51-4f17-43d9-961f-6d8ef0752efc" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-bae4dd51-4f17-43d9-961f-6d8ef0752efc" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d63fd-0063-4b65-aa03-0b4952801bb4]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:16:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:06 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:16:06 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:07 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 0.702s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:07 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:16:07 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:08 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 1 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:16:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:08 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc
Jun 17 04:16:08 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:08 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bae4dd51-4f17-43d9-961f-6d8ef0752efc" returned: 0 in 0.689s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-quobyte-bae4dd51-4f17-43d9-961f-6d8ef0752efc" released by "delete_volume" :: held 2.199s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:09 devstack cinder-volume[92204]: WARNING cinder.quota [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-439200683-672122314 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-439200683-672122314, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:16:09 devstack cinder-volume[92204]: WARNING cinder.quota [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-439200683-672122314 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-439200683-672122314, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Created reservations ['b998c6ab-c6c4-4456-ae03-034a62c19729', '11e9fac3-ce5a-4bee-95f3-735d98b573d9', '9f681346-8d43-4bc2-9778-24761481b9e9', '588297ff-d0cb-4278-a5a8-95e51e677440'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:09 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:16:09 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:09 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.641s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:16:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Deleted volume successfully.
Jun 17 04:16:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5787ca72-cacd-40e6-aac4-eaca70e1858f tempest-TestInstancesWithCinderVolumes-266447307 None] Lock "cinder-bae4dd51-4f17-43d9-961f-6d8ef0752efc-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-88c7315b-40a2-4b4e-8521-ad2a746a2a9b req-a68b7e02-92fb-48af-b100-752addf90260 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Terminate volume connection completed successfully.
Jun 17 04:16:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-88c7315b-40a2-4b4e-8521-ad2a746a2a9b req-a68b7e02-92fb-48af-b100-752addf90260 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Deleting attachment ff8d6961-a43d-4bad-97c6-12f701732bab. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "cinder-95ea2f14-d1c6-4d49-a60d-94e151b86b42-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "cinder-95ea2f14-d1c6-4d49-a60d-94e151b86b42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "cinder-quobyte-95ea2f14-d1c6-4d49-a60d-94e151b86b42" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "cinder-quobyte-95ea2f14-d1c6-4d49-a60d-94e151b86b42" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e319213-b8e2-493e-84ff-d32dee35aa96]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:16:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:13 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42
Jun 17 04:16:13 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:14 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:14 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42
Jun 17 04:16:14 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:15 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-95ea2f14-d1c6-4d49-a60d-94e151b86b42" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "cinder-quobyte-95ea2f14-d1c6-4d49-a60d-94e151b86b42" released by "delete_volume" :: held 1.455s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Created reservations ['b7bc74df-8f61-4150-bcfa-11dd61e09ea9', '4fa07e2e-cb62-4858-81de-d7821b9975bf', '3f229587-925d-44c9-9f81-d9df5108041f', '57933302-e369-4862-aecd-dfe4745f7612'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:15 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:16:15 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:16 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:16 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:16:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Deleted volume successfully.
Jun 17 04:16:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f90cd5d-caf4-40d7-bc4f-fa5ace2c8698 tempest-TestServerVolumeAttachScenarioOldVersion-955086760 None] Lock "cinder-95ea2f14-d1c6-4d49-a60d-94e151b86b42-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=79,cinder:UPDATE=99,cinder:DELETE=8,cinder:INSERT=13 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=79,cinder:UPDATE=91,cinder:INSERT=29,cinder:DELETE=7 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Flow 'volume_create_manager' (90023331-1c09-44f1-8c70-ee332b51dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06fd2e-ecf1-4a3d-9dba-cf56957230b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06fd2e-ecf1-4a3d-9dba-cf56957230b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067866924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9167ea-83f3-48ff-88d4-4cf28fbcde1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8de88e771ff4698a8146c013ae639d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:24Z,use_quota=True,user_id='333b126e190947e7a782f110fb978546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f2b0c9-8251-42f7-9ac6-0c7b30663081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f2b0c9-8251-42f7-9ac6-0c7b30663081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e8b2ca-42a9-4210-976c-7b93f3fc6b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e8b2ca-42a9-4210-976c-7b93f3fc6b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9167ea-83f3-48ff-88d4-4cf28fbcde1d', 'volume_name': 'volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9256aa-2632-45da-bd7f-60b07a95eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9256aa-2632-45da-bd7f-60b07a95eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1976b48c-f4e3-4c6e-9426-52cb2af374b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:24 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d', 'volume_size': 1}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067866924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9167ea-83f3-48ff-88d4-4cf28fbcde1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8de88e771ff4698a8146c013ae639d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:24Z,use_quota=True,user_id='333b126e190947e7a782f110fb978546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Creating volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:16:24 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:16:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:24 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d 1073741824
Jun 17 04:16:24 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:25 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d 1073741824" returned: 0 in 0.985s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:25 devstack sudo[106838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:16:25 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:26 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.653s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1976b48c-f4e3-4c6e-9426-52cb2af374b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a17b0f-f96e-46e4-9242-ccc2ef464eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Volume volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d (bd9167ea-83f3-48ff-88d4-4cf28fbcde1d): created successfully
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a17b0f-f96e-46e4-9242-ccc2ef464eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Flow 'volume_create_manager' (90023331-1c09-44f1-8c70-ee332b51dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-16a12cdb-3318-4a09-b0af-b74175454381 tempest-VolumesActionsTest-106781194 None] Created volume successfully.
Jun 17 04:16:36 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:16:36 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Flow 'volume_create_manager' (fbace062-a4cb-478f-b7b5-68976cd4aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b0a54b-f849-42f6-a5ff-00b638ea8c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b0a54b-f849-42f6-a5ff-00b638ea8c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1272868298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859de878-2d02-4790-a22f-13e2b226bedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694d82988bf4218aede91e60f2e3df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:46Z,use_quota=True,user_id='90829e35ea304ede858c29a734a6e837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23d5bfd-0e85-477e-ad3b-96380a83f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23d5bfd-0e85-477e-ad3b-96380a83f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ffd7e6-2e9d-43ac-88b1-7c07053e7b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ffd7e6-2e9d-43ac-88b1-7c07053e7b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859de878-2d02-4790-a22f-13e2b226bedc', 'volume_name': 'volume-859de878-2d02-4790-a22f-13e2b226bedc', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657bce52-f0b1-448c-90c3-2fe6daf694a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657bce52-f0b1-448c-90c3-2fe6daf694a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676f8a33-6e48-442f-a127-33b802e2b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:45 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Volume 859de878-2d02-4790-a22f-13e2b226bedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859de878-2d02-4790-a22f-13e2b226bedc', 'volume_size': 1}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1272868298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859de878-2d02-4790-a22f-13e2b226bedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694d82988bf4218aede91e60f2e3df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:16:46Z,use_quota=True,user_id='90829e35ea304ede858c29a734a6e837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Creating volume 859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:16:45 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:16:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:45 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc 1073741824
Jun 17 04:16:45 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:46 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc 1073741824" returned: 0 in 0.966s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:16:46 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:16:46 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:16:47 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Jun 17 04:16:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 1.121s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:16:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:16:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:16:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676f8a33-6e48-442f-a127-33b802e2b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859de878-2d02-4790-a22f-13e2b226bedc', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65a5850-b77f-4824-938a-93191826692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:16:48 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Volume volume-859de878-2d02-4790-a22f-13e2b226bedc (859de878-2d02-4790-a22f-13e2b226bedc): created successfully
Jun 17 04:16:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65a5850-b77f-4824-938a-93191826692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:16:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Flow 'volume_create_manager' (fbace062-a4cb-478f-b7b5-68976cd4aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:16:48 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-26f852f5-2a9f-41eb-8e1b-fb9e676b934b tempest-TestStampPattern-564531214 None] Created volume successfully.
Jun 17 04:16:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-59009a8a-6196-47af-9e91-aedbc5925318 tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" by "attach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-59009a8a-6196-47af-9e91-aedbc5925318 tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" acquired by "attach_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-59009a8a-6196-47af-9e91-aedbc5925318 tempest-VolumesActionsTest-106781194 None] Attaching volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d to instance 33cf04bb-166a-4dd7-8f20-2a71f4c447ae at mountpoint /dev/vdb on host None.
Jun 17 04:16:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-59009a8a-6196-47af-9e91-aedbc5925318 tempest-VolumesActionsTest-106781194 None] Attach volume completed successfully.
Jun 17 04:16:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-59009a8a-6196-47af-9e91-aedbc5925318 tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" released by "attach_volume" :: held 0.111s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:16:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c461db36-8ced-4051-8156-934f3e8fb12a tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" by "detach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:16:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c461db36-8ced-4051-8156-934f3e8fb12a tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:16:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c461db36-8ced-4051-8156-934f3e8fb12a tempest-VolumesActionsTest-106781194 None] Detaching volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d from instance 33cf04bb-166a-4dd7-8f20-2a71f4c447ae.
Jun 17 04:16:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c461db36-8ced-4051-8156-934f3e8fb12a tempest-VolumesActionsTest-106781194 None] Detach volume completed successfully.
Jun 17 04:16:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-c461db36-8ced-4051-8156-934f3e8fb12a tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:17:01 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:17:01 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:02 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:17:02 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:02 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.752s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:17:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Flow 'volume_create_manager' (47d041f5-f3f3-4ba0-9ee9-e7f95aaed60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f415fa02-10b1-4f02-bad2-db23c3490ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f415fa02-10b1-4f02-bad2-db23c3490ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1836167250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bec95ba-6de5-44e2-896b-1e046c400201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cf940521074962a907eab025e07dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:17:08Z,use_quota=True,user_id='197bf4241577433dab15018438dd1338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a809d284-2de9-4742-b476-1f6c8dd4f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a809d284-2de9-4742-b476-1f6c8dd4f789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5a0439-652e-4693-86fa-5520e48d2a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5a0439-652e-4693-86fa-5520e48d2a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bec95ba-6de5-44e2-896b-1e046c400201', 'volume_name': 'volume-2bec95ba-6de5-44e2-896b-1e046c400201', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8a648-0b26-4172-b407-5cf47f8dfb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8a648-0b26-4172-b407-5cf47f8dfb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2831c1-14e5-46fb-9884-a5f4f09b699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:08 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume 2bec95ba-6de5-44e2-896b-1e046c400201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bec95ba-6de5-44e2-896b-1e046c400201', 'volume_size': 1}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1836167250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bec95ba-6de5-44e2-896b-1e046c400201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cf940521074962a907eab025e07dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:17:08Z,use_quota=True,user_id='197bf4241577433dab15018438dd1338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Creating volume 2bec95ba-6de5-44e2-896b-1e046c400201 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:17:08 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:17:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:08 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 1073741824
Jun 17 04:17:08 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Flow 'volume_create_manager' (6154a627-92ff-4de8-86f6-1f0e766e8dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dee44f-ed4d-4baf-b6e1-28d3b88c3554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dee44f-ed4d-4baf-b6e1-28d3b88c3554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-128250385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c43cd8-df67-456d-8d7c-7d8215259e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cf940521074962a907eab025e07dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:17:09Z,use_quota=True,user_id='197bf4241577433dab15018438dd1338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346c08e-64c2-4114-924b-19d47656c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346c08e-64c2-4114-924b-19d47656c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4818ddd-2012-4d76-bc07-d785b14f87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4818ddd-2012-4d76-bc07-d785b14f87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c43cd8-df67-456d-8d7c-7d8215259e3b', 'volume_name': 'volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d0404-ad5f-4390-b53e-8dea133d0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d0404-ad5f-4390-b53e-8dea133d0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb383035-ac8b-4d51-9192-7f5b6c6a0252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:09 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume f5c43cd8-df67-456d-8d7c-7d8215259e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b', 'volume_size': 1}
Jun 17 04:17:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:10 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 1073741824" returned: 0 in 1.475s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:10 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201
Jun 17 04:17:10 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:10 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201" returned: 0 in 0.767s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-128250385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c43cd8-df67-456d-8d7c-7d8215259e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cf940521074962a907eab025e07dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:17:09Z,use_quota=True,user_id='197bf4241577433dab15018438dd1338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Creating volume f5c43cd8-df67-456d-8d7c-7d8215259e3b {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:17:10 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:17:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2831c1-14e5-46fb-9884-a5f4f09b699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bec95ba-6de5-44e2-896b-1e046c400201', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:11 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b 1073741824
Jun 17 04:17:11 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d194df40-e11e-4af8-941a-61ea12ef7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:11 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume volume-2bec95ba-6de5-44e2-896b-1e046c400201 (2bec95ba-6de5-44e2-896b-1e046c400201): created successfully
Jun 17 04:17:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d194df40-e11e-4af8-941a-61ea12ef7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Flow 'volume_create_manager' (47d041f5-f3f3-4ba0-9ee9-e7f95aaed60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:17:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-70eee95d-d38e-4a99-98f7-63347d1e1700 tempest-TestServerVolumeAttachmentScenario-653242909 None] Created volume successfully.
Jun 17 04:17:12 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b 1073741824" returned: 0 in 1.083s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:12 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b
Jun 17 04:17:12 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:12 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b" returned: 0 in 0.878s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:17:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb383035-ac8b-4d51-9192-7f5b6c6a0252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c53bae-f1b4-4fcc-a05d-7d1c1a83b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:17:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Volume volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b (f5c43cd8-df67-456d-8d7c-7d8215259e3b): created successfully
Jun 17 04:17:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c53bae-f1b4-4fcc-a05d-7d1c1a83b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:17:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Flow 'volume_create_manager' (6154a627-92ff-4de8-86f6-1f0e766e8dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:17:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f23f5921-69c6-4f8b-8c60-a0c75ef818d3 tempest-TestServerVolumeAttachmentScenario-653242909 None] Created volume successfully.
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f069ccd3-d642-4572-9755-ddcae515d803 tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" by "attach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f069ccd3-d642-4572-9755-ddcae515d803 tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" acquired by "attach_volume" :: waited 0.027s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:17:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f069ccd3-d642-4572-9755-ddcae515d803 tempest-VolumesActionsTest-106781194 None] Attaching volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d to instance 0682c418-86bc-41b3-8128-df92057b00c8 at mountpoint /dev/vdb on host None.
Jun 17 04:17:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f069ccd3-d642-4572-9755-ddcae515d803 tempest-VolumesActionsTest-106781194 None] Attach volume completed successfully.
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f069ccd3-d642-4572-9755-ddcae515d803 tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" released by "attach_volume" :: held 0.090s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cc15d07a-aa7a-46bc-8395-ecea496c120b tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" by "detach_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cc15d07a-aa7a-46bc-8395-ecea496c120b tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:17:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-cc15d07a-aa7a-46bc-8395-ecea496c120b tempest-VolumesActionsTest-106781194 None] Detaching volume bd9167ea-83f3-48ff-88d4-4cf28fbcde1d from instance 0682c418-86bc-41b3-8128-df92057b00c8.
Jun 17 04:17:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-cc15d07a-aa7a-46bc-8395-ecea496c120b tempest-VolumesActionsTest-106781194 None] Detach volume completed successfully.
Jun 17 04:17:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cc15d07a-aa7a-46bc-8395-ecea496c120b tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:17:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0362b-bb72-4362-9717-45f5a4602729]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:30 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:17:30 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:30 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:17:31 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.798s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4270d9-6c1d-44c7-b3fb-2cb653bc3c16]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:31 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:17:31 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:32 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.98876f63-8d19-41ce-b7ce-cfe8c466352b0pdzawsd.img {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:32 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.98876f63-8d19-41ce-b7ce-cfe8c466352b0pdzawsd.img
Jun 17 04:17:32 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:37 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.98876f63-8d19-41ce-b7ce-cfe8c466352b0pdzawsd.img" returned: 0 in 5.656s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:37 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[feddd3d6-4da7-43eb-b40d-0f5772d11281]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:37 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:17:37 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:38 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.887s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:38 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.98876f63-8d19-41ce-b7ce-cfe8c466352b0pdzawsd.img {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:17:38 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Converted 1024.00 MB image at 180.98 MB/s
Jun 17 04:17:38 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] 98876f63-8d19-41ce-b7ce-cfe8c466352b was raw, no need to convert to raw {{(pid=92204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 17 04:17:48 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:17:48 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:17:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.469s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Uploaded volume to glance image-id: 98876f63-8d19-41ce-b7ce-cfe8c466352b. {{(pid=92204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 17 04:17:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.756s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eaa843-2c20-4849-8cc7-601520eed6f2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b83e2f03-5cf6-4596-8f85-4d83818cabb9 tempest-VolumesActionsTest-106781194 None] Copy volume to image completed successfully.
Jun 17 04:17:57 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:17:57 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:57 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.831s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.848s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.188s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d311623-ca8c-4045-b2dd-1210f46ebc28]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-859de878-2d02-4790-a22f-13e2b226bedc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aabbf5b0-772a-451a-95c5-a9af337971c7', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:17:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-0ca02247-0e80-466a-b76d-a906d69c02ca req-2f7b48a5-a771-41ad-bb3e-c564c04742b6 tempest-TestStampPattern-564531214 None] attachment_update completed successfully.
Jun 17 04:17:57 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201
Jun 17 04:17:57 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:58 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201" returned: 0 in 0.752s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:17:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-2bec95ba-6de5-44e2-896b-1e046c400201', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f198fd0-e471-4535-8e48-a582d09575d5', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:17:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-f3aa1589-f7e8-4cbc-95b7-42fea2cba5bb req-39246b82-503a-470c-a968-18c904728d29 tempest-TestServerVolumeAttachmentScenario-653242909 None] attachment_update completed successfully.
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd914a-3979-4935-b960-88a3f2e3bbb5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:17:59 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:17:59 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:17:59 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.726s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40206b-9998-4cf3-bcad-3330646b09d5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:17:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:00 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:18:00 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:00 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:00 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img
Jun 17 04:18:00 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:02 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:18:02 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:03 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:18:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:18:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:18:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:18:05 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img" returned: 0 in 5.282s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ae23b-8caf-4e69-b711-d511964e2d64]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:06 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:18:06 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:06 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.943s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:06 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:18:06 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Converted 1024.00 MB image at 193.84 MB/s
Jun 17 04:18:06 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] 7aedcd3c-33c2-43d5-901d-72845c0499d2 was raw, converting to qcow2 {{(pid=92204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 17 04:18:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc5e997-fd84-4d4c-9f3b-56f5d9dc8849]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:07 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img
Jun 17 04:18:07 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:07 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img" returned: 0 in 0.733s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:07 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img
Jun 17 04:18:07 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:08 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img" returned: 1 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:08 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf
Jun 17 04:18:08 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-725ccd90-a5d9-48c2-bdd7-c52010456b61 req-51f18a0c-4a16-4890-9b16-56019c7ecaf3 tempest-TestStampPattern-564531214 None] Terminate volume connection completed successfully.
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-725ccd90-a5d9-48c2-bdd7-c52010456b61 req-51f18a0c-4a16-4890-9b16-56019c7ecaf3 tempest-TestStampPattern-564531214 None] Deleting attachment aabbf5b0-772a-451a-95c5-a9af337971c7. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:18:08 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Image conversion details: src /opt/stack/data/cinder/conversion/bd9167ea-83f3-48ff-88d4-4cf28fbcde1d.temp_image.7aedcd3c-33c2-43d5-901d-72845c0499d2tiqgka_i.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:18:08 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f007762-e73a-43bd-8e92-069a7c3f0b4a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:09 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf
Jun 17 04:18:09 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:09 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4fr_tyzf" returned: 0 in 0.666s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.669s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Uploaded volume to glance image-id: 7aedcd3c-33c2-43d5-901d-72845c0499d2. {{(pid=92204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.598s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5528ceb-f056-4b89-b74d-e14afdf14d69]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a5f4952f-952e-4f37-b700-c5536562c780 tempest-VolumesActionsTest-106781194 None] Copy volume to image completed successfully.
Jun 17 04:18:11 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b
Jun 17 04:18:11 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:11 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b" returned: 0 in 0.703s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.989s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Creating offline snapshot 1ca766a8-3d87-4ba0-bf32-1978b85b48d7 of volume 859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99616f8-38ca-4317-8c35-9680ba5e592b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5df402cc-3fef-4f85-990a-70d9aeb57d23', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:18:11 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-2d9c1ded-ba5f-49e4-a5f8-d14170884a56 req-ed87a58c-edea-4055-af2c-c5000131ea55 tempest-TestServerVolumeAttachmentScenario-653242909 None] attachment_update completed successfully.
Jun 17 04:18:11 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:18:11 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:12 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.758s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:12 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 1G
Jun 17 04:18:12 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Acquiring lock "cinder-quobyte-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "cinder-quobyte-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[32583a06-009f-4cf5-a047-04bf1e48cc64]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:12 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:18:12 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:13 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 1G" returned: 0 in 0.796s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859de878-2d02-4790-a22f-13e2b226bedc -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:13 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859de878-2d02-4790-a22f-13e2b226bedc -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:18:13 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:13 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.740s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:13 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d
Jun 17 04:18:13 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:13 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859de878-2d02-4790-a22f-13e2b226bedc -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.624s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:13 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 is being set with open permissions: ugo+rw
Jun 17 04:18:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:13 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:18:13 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:13 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" returned: 0 in 0.595s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "cinder-quobyte-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d" released by "delete_volume" :: held 1.396s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Created reservations ['f5cf9b19-e6a0-43f8-95da-9f7798a66ede', 'fff315f8-f931-414a-a978-14dd76b41a8d', '64ebb9bc-1dc7-413f-8957-2b3b0289bd4f', '47082157-2443-4c47-9bd4-8351cdb15404'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:14 devstack sudo[108082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:18:14 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:14 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:14 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info
Jun 17 04:18:14 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:14 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:18:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Deleted volume successfully.
Jun 17 04:18:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0fb25647-2b1d-443f-a750-56f72693d77f tempest-VolumesActionsTest-106781194 None] Lock "cinder-bd9167ea-83f3-48ff-88d4-4cf28fbcde1d-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:15 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:15 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info is being set with open permissions: ugo+rw
Jun 17 04:18:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:15 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info
Jun 17 04:18:15 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:15 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.info" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:15 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c6001669-7f96-41cd-873d-1e83bc67df64 tempest-TestStampPattern-564531214 None] Create snapshot completed successfully
Jun 17 04:18:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-66a124ab-9317-4831-a2e4-43b76ec3f95b req-605f428e-9eb3-4a58-b961-db901210cd9e tempest-TestServerVolumeAttachmentScenario-653242909 None] Terminate volume connection completed successfully.
Jun 17 04:18:17 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-66a124ab-9317-4831-a2e4-43b76ec3f95b req-605f428e-9eb3-4a58-b961-db901210cd9e tempest-TestServerVolumeAttachmentScenario-653242909 None] Deleting attachment 5df402cc-3fef-4f85-990a-70d9aeb57d23. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Flow 'volume_create_manager' (386d50de-581a-4e3b-94c8-727eb59ef048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64cbdf7-159c-4cf9-920a-3f5cdc60d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64cbdf7-159c-4cf9-920a-3f5cdc60d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051721155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aedce7ef6074a4fac862b6f97ae181c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:21Z,use_quota=True,user_id='c4b87d71313b4c79bfba0a82b60bb7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d945f4-4e93-4c2f-9183-5461fa1ecd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d945f4-4e93-4c2f-9183-5461fa1ecd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022f71bb-b62c-4faf-a17c-0658dc74bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:18:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-34759c16-f42f-48b7-a337-e662252f2d02 req-6dc02f98-8bdd-41f3-98a9-6ff7b556f0f5 tempest-TestServerVolumeAttachmentScenario-653242909 None] Terminate volume connection completed successfully.
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-34759c16-f42f-48b7-a337-e662252f2d02 req-6dc02f98-8bdd-41f3-98a9-6ff7b556f0f5 tempest-TestServerVolumeAttachmentScenario-653242909 None] Deleting attachment 7f198fd0-e471-4535-8e48-a582d09575d5. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022f71bb-b62c-4faf-a17c-0658dc74bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d', 'volume_name': 'volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3b7fe0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da9d414-1979-4dae-8608-ccf4dc6b7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da9d414-1979-4dae-8608-ccf4dc6b7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f2c0d2-6d4a-48f0-b843-5a22db2ae120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3b7fe0>}
Jun 17 04:18:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Trying to clone fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d from image 6b933bbd-ad87-411f-8a67-3350ca673beb at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:18:21 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:18:21 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Image download 20.69 MB at 20.69 MB/s
Jun 17 04:18:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2ecb17-4c7e-45b5-a29b-c24065bdc3f6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:21 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD
Jun 17 04:18:21 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:21 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:21 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb is fetched for user c4b87d71313b4c79bfba0a82b60bb7df. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b30d9e-acf9-4996-bbe4-8dab4cafac9b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:22 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD
Jun 17 04:18:22 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:22 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051721155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aedce7ef6074a4fac862b6f97ae181c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:21Z,use_quota=True,user_id='c4b87d71313b4c79bfba0a82b60bb7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Creating volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:22 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:22 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1073741824
Jun 17 04:18:22 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:23 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1073741824" returned: 0 in 0.884s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:23 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:23 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:24 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 0.683s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Attempting download of 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c6aa8c-1c49-4595-96cf-b409bd49739d]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:24 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79
Jun 17 04:18:24 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:25 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79" returned: 0 in 0.909s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:25 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79
Jun 17 04:18:25 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:26 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79" returned: 1 in 0.795s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_dcncfc79' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93619c-14db-49fb-b83b-5c40e43359c9]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:26 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD
Jun 17 04:18:26 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Flow 'volume_create_manager' (315d140c-a4d6-436d-be7f-6eb079f31467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6681d6f6-257e-4358-b3d6-dab1dbe4a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6681d6f6-257e-4358-b3d6-dab1dbe4a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1884753062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79971efb-fe29-4182-a993-a52f5ca547ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694d82988bf4218aede91e60f2e3df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ca766a8-3d87-4ba0-bf32-1978b85b48d7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:27Z,use_quota=True,user_id='90829e35ea304ede858c29a734a6e837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e021fc-7dcc-4a3c-93a2-760e0daac281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e021fc-7dcc-4a3c-93a2-760e0daac281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf2940c-3667-4245-a006-18dba172ea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf2940c-3667-4245-a006-18dba172ea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79971efb-fe29-4182-a993-a52f5ca547ec', 'volume_name': 'volume-79971efb-fe29-4182-a993-a52f5ca547ec', 'volume_size': 1, 'snapshot_id': '1ca766a8-3d87-4ba0-bf32-1978b85b48d7'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d96703b-e95c-4880-bb73-928489a6c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d96703b-e95c-4880-bb73-928489a6c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8749ad36-061a-4b41-a77f-5bc32e973a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Volume 79971efb-fe29-4182-a993-a52f5ca547ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79971efb-fe29-4182-a993-a52f5ca547ec', 'volume_size': 1, 'snapshot_id': '1ca766a8-3d87-4ba0-bf32-1978b85b48d7'}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-79971efb-fe29-4182-a993-a52f5ca547ec" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-79971efb-fe29-4182-a993-a52f5ca547ec" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Creating volume 79971efb-fe29-4182-a993-a52f5ca547ec from snapshot 1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] snapshot: 1ca766a8-3d87-4ba0-bf32-1978b85b48d7, volume: 79971efb-fe29-4182-a993-a52f5ca547ec,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df16950-0221-4390-bd28-aec9b09ad921]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:27 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD" returned: 0 in 0.892s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] 6b933bbd-ad87-411f-8a67-3350ca673beb was qcow2, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:27 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:27 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:27 devstack sudo[108242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:18:27 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:27 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859de878-2d02-4790-a22f-13e2b226bedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea458e5a-9a06-4f58-80d4-370fe1d9f1fd]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:28 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:18:28 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:28 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.840s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:28 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:18:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:28 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec
Jun 17 04:18:28 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:29 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 2.171s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:29 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_7t_bhjo2devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:18:29 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Converted 112.00 MB image at 51.56 MB/s
Jun 17 04:18:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:29 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1G
Jun 17 04:18:29 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:30 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 1G" returned: 0 in 0.933s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7282907-3bb7-4ce4-94d1-b33c26b635e6]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:30 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:30 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:31 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 1.214s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:31 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:31 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:33 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 1 in 1.493s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Downloaded image 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb for user c4b87d71313b4c79bfba0a82b60bb7df is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Marking volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Copying metadata from image 6b933bbd-ad87-411f-8a67-3350ca673beb to fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Creating volume glance metadata for volume fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d backed by image 6b933bbd-ad87-411f-8a67-3350ca673beb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f2c0d2-6d4a-48f0-b843-5a22db2ae120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3b7fe0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42331003-dbc8-404b-bcb9-b11224d2fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:33 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Volume volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d (fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d): created successfully
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42331003-dbc8-404b-bcb9-b11224d2fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Flow 'volume_create_manager' (386d50de-581a-4e3b-94c8-727eb59ef048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0d6e4c56-0591-433c-8c4b-6bb8ab6a853b tempest-VolumesExtendTest-1324742537 None] Created volume successfully.
Jun 17 04:18:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:34 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec" returned: 0 in 5.754s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e9497a-57a0-444e-a86e-51d74d0e188e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:34 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:18:34 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "cinder-f5c43cd8-df67-456d-8d7c-7d8215259e3b-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-f5c43cd8-df67-456d-8d7c-7d8215259e3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "cinder-quobyte-f5c43cd8-df67-456d-8d7c-7d8215259e3b" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-quobyte-f5c43cd8-df67-456d-8d7c-7d8215259e3b" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d426f42-de58-48dd-927c-00c4ddf518ab]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:35 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b
Jun 17 04:18:35 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:35 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 1.011s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:18:35 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Converted 1024.00 MB image at 177.94 MB/s
Jun 17 04:18:35 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec is being set with open permissions: ugo+rw
Jun 17 04:18:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:35 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec
Jun 17 04:18:35 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:36 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b" returned: 0 in 0.835s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:36 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b
Jun 17 04:18:36 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:36 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec" returned: 0 in 0.761s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" released by "_copy_volume_from_snapshot" :: held 9.354s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-79971efb-fe29-4182-a993-a52f5ca547ec" released by "_create_volume_from_snapshot" :: held 9.393s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.420s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.218s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8749ad36-061a-4b41-a77f-5bc32e973a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79971efb-fe29-4182-a993-a52f5ca547ec', 'volume_size': 1, 'snapshot_id': '1ca766a8-3d87-4ba0-bf32-1978b85b48d7'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc54862d-c93b-4655-92a0-976289e3cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[150eeb9a-4593-4fb8-8552-7e45963255aa]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Volume volume-79971efb-fe29-4182-a993-a52f5ca547ec (79971efb-fe29-4182-a993-a52f5ca547ec): created successfully
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc54862d-c93b-4655-92a0-976289e3cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Flow 'volume_create_manager' (315d140c-a4d6-436d-be7f-6eb079f31467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:36 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ce6ab7b5-aaea-474f-8f91-c14aea6886b1 tempest-TestStampPattern-564531214 None] Created volume successfully.
Jun 17 04:18:36 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:36 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:36 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f5c43cd8-df67-456d-8d7c-7d8215259e3b" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-quobyte-f5c43cd8-df67-456d-8d7c-7d8215259e3b" released by "delete_volume" :: held 1.611s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:36 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Created reservations ['7c4730ca-8fe9-433a-8c69-00a0a8d3fed5', '9d277fe9-ee44-45f3-b1af-50eee82ffae0', '15ac5f82-3163-4099-8f90-76b94b0b3081', '66c66525-4938-44fc-a747-8fa09f42e2f4'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:37 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:18:37 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "cinder-2bec95ba-6de5-44e2-896b-1e046c400201-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-2bec95ba-6de5-44e2-896b-1e046c400201-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "cinder-quobyte-2bec95ba-6de5-44e2-896b-1e046c400201" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-quobyte-2bec95ba-6de5-44e2-896b-1e046c400201" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2086df0-449c-42b3-b139-e7ad7031197d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:37 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 1.084s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:37 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201
Jun 17 04:18:37 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:37 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:37 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:37 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.869s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:18:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Deleted volume successfully.
Jun 17 04:18:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4e2fe517-3ed5-422b-b180-9ceb7c2fad76 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-f5c43cd8-df67-456d-8d7c-7d8215259e3b-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:38 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 1 in 0.771s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 2G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:38 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201" returned: 0 in 0.816s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:38 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201
Jun 17 04:18:38 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d 2G" returned: 0 in 0.081s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.026s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8583f509-a400-4549-ab3f-1a09943f4030 tempest-VolumesExtendTest-1324742537 None] Extend volume completed successfully.
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-quobyte-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:39 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d25fa1-954e-4cfe-bb18-b841afc54d6c]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2bec95ba-6de5-44e2-896b-1e046c400201" returned: 0 in 0.677s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-quobyte-2bec95ba-6de5-44e2-896b-1e046c400201" released by "delete_volume" :: held 1.576s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Created reservations ['76e410f5-a994-465f-8430-c1626b891ca4', 'b8756e41-7baf-4b4d-88d3-759412fa0d59', 'e20523e1-d74b-4b3a-b035-7c30af48a128', '0820d299-281c-47e0-a2cd-daeff6574b8f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:18:39 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:39 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:39 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:18:39 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:39 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 0.808s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:39 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:18:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Deleted volume successfully.
Jun 17 04:18:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7756958e-de88-4338-88c0-b205694f7217 tempest-TestServerVolumeAttachmentScenario-653242909 None] Lock "cinder-2bec95ba-6de5-44e2-896b-1e046c400201-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:39 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:39 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:40 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 1 in 0.761s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:18:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:40 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d
Jun 17 04:18:40 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:41 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" returned: 0 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d" released by "delete_volume" :: held 2.384s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Created reservations ['a922ab68-1349-4441-9661-a5757ad7e0bb', '3828e158-436d-4b7e-8aca-2bf1e9f329ef', 'cf4a7013-542b-415c-bb6d-9df85bd4fbd0', '77e353bc-f9a2-45e9-a16f-916d4896f57c'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:41 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:18:41 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:42 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.644s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:18:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Deleted volume successfully.
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0ce358e1-bb0c-4342-a7b8-32ad65bb5aa0 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-fb767f7f-298a-4a1c-a5e7-7a5f25d9c00d-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Flow 'volume_create_manager' (4aef8603-3f20-40f6-a2b5-13e827e6c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b85737-e4e7-4b13-8abb-28d9f159f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b85737-e4e7-4b13-8abb-28d9f159f786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1369145150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c2d8d1-979f-4bb4-88af-442d4eac45f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aedce7ef6074a4fac862b6f97ae181c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:42Z,use_quota=True,user_id='c4b87d71313b4c79bfba0a82b60bb7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596d0481-ac70-45e9-bca1-bf73a60b0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596d0481-ac70-45e9-bca1-bf73a60b0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580ba6f4-54e7-4e05-8293-5396e163fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580ba6f4-54e7-4e05-8293-5396e163fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c2d8d1-979f-4bb4-88af-442d4eac45f3', 'volume_name': 'volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e44814-ef25-4031-8e3f-520ad1fb1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e44814-ef25-4031-8e3f-520ad1fb1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d4d7d8-4b1f-4494-beed-a1ac2b1a30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:42 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Volume b9c2d8d1-979f-4bb4-88af-442d4eac45f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3', 'volume_size': 1}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1369145150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c2d8d1-979f-4bb4-88af-442d4eac45f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aedce7ef6074a4fac862b6f97ae181c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:42Z,use_quota=True,user_id='c4b87d71313b4c79bfba0a82b60bb7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Creating volume b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:42 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:42 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 1073741824
Jun 17 04:18:42 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:43 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 1073741824" returned: 0 in 1.101s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:43 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:18:43 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:44 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d4d7d8-4b1f-4494-beed-a1ac2b1a30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44004ca7-75d2-4d89-ae78-d8eb7778a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:44 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Volume volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 (b9c2d8d1-979f-4bb4-88af-442d4eac45f3): created successfully
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44004ca7-75d2-4d89-ae78-d8eb7778a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Flow 'volume_create_manager' (4aef8603-3f20-40f6-a2b5-13e827e6c282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3785f18c-f84b-4251-9e0a-4afd9ddd0fd0 tempest-VolumesExtendTest-1324742537 None] Created volume successfully.
Jun 17 04:18:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Creating offline snapshot 843870c7-00a2-477c-8fee-8273ab2699e6 of volume b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:18:46 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc3259-18fb-4f3f-bd8d-cc4831b44492]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:46 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:18:46 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:47 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 1.173s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:47 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 1G
Jun 17 04:18:47 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:48 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 1G" returned: 0 in 1.105s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:48 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6
Jun 17 04:18:48 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:49 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6" returned: 0 in 0.782s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:49 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 is being set with open permissions: ugo+rw
Jun 17 04:18:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:49 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6
Jun 17 04:18:49 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:50 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6" returned: 0 in 0.851s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=53,cinder:UPDATE=54,cinder:INSERT=22,cinder:DELETE=3 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=71,cinder:UPDATE=49,cinder:INSERT=10,cinder:DELETE=5 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:50 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info
Jun 17 04:18:50 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:50 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:50 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info is being set with open permissions: ugo+rw
Jun 17 04:18:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:51 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info
Jun 17 04:18:51 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:51 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.info" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.374s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-dab5342f-3e47-46e1-8024-93c7c550543d tempest-VolumesExtendTest-1324742537 None] Create snapshot completed successfully
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (4b8da13c-4f27-446e-bd75-fe946f7b21a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd44b91f-1a35-421a-bfc6-3cf3ecb52887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd44b91f-1a35-421a-bfc6-3cf3ecb52887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50486528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56710b4-d243-4ae6-b9ea-c47951ccbf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:52Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6253e2-e38c-411d-b300-69cbcf739bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6253e2-e38c-411d-b300-69cbcf739bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aeb8ef-7996-47cf-b875-a151fd801a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aeb8ef-7996-47cf-b875-a151fd801a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56710b4-d243-4ae6-b9ea-c47951ccbf4f', 'volume_name': 'volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac2a7c5-bef9-4f47-88ff-6ffa2fcb7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac2a7c5-bef9-4f47-88ff-6ffa2fcb7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e2a5d-bd8c-4a67-b265-6d490e388e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:52 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume b56710b4-d243-4ae6-b9ea-c47951ccbf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f', 'volume_size': 1}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50486528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56710b4-d243-4ae6-b9ea-c47951ccbf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:52Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume b56710b4-d243-4ae6-b9ea-c47951ccbf4f {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:52 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:52 devstack sudo[108506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f 1073741824
Jun 17 04:18:52 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:53 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f 1073741824" returned: 0 in 0.808s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:53 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f
Jun 17 04:18:53 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:53 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" returned: 0 in 0.608s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.040s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e2a5d-bd8c-4a67-b265-6d490e388e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da4c656-0006-4464-9c7c-4515c801f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d277e64-a62e-46b5-99ca-dd77888a8ca7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:53 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f (b56710b4-d243-4ae6-b9ea-c47951ccbf4f): created successfully
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da4c656-0006-4464-9c7c-4515c801f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (4b8da13c-4f27-446e-bd75-fe946f7b21a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:53 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0c2c12fd-f3cf-4d81-831e-1a734676d121 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:18:53 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:18:53 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:54 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 0.780s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 2G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 2G" returned: 0 in 0.152s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.994s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (28a57e01-7e66-4e5d-90f3-939ab56ba295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d787d6db-0d73-4090-8088-07911a19df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f5e8a629-1b53-4e9c-afcc-70f77af8aae0 tempest-VolumesExtendTest-1324742537 None] Extend volume completed successfully.
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d787d6db-0d73-4090-8088-07911a19df69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106480547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d42cc6-7170-4733-ace7-ff60320ef42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:55Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b38fbb9-082d-4ccf-ba30-eb3ef93fd2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b38fbb9-082d-4ccf-ba30-eb3ef93fd2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dccd26-9af6-4ad3-a8de-f873f4498440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dccd26-9af6-4ad3-a8de-f873f4498440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d42cc6-7170-4733-ace7-ff60320ef42c', 'volume_name': 'volume-b4d42cc6-7170-4733-ace7-ff60320ef42c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219d566-0a1a-4802-a4e5-2ff39d714e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219d566-0a1a-4802-a4e5-2ff39d714e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffbbb99-3c95-450d-abe5-f24264bb2252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:54 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume b4d42cc6-7170-4733-ace7-ff60320ef42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d42cc6-7170-4733-ace7-ff60320ef42c', 'volume_size': 1}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106480547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d42cc6-7170-4733-ace7-ff60320ef42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:55Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume b4d42cc6-7170-4733-ace7-ff60320ef42c {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:54 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:54 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c 1073741824
Jun 17 04:18:54 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-843870c7-00a2-477c-8fee-8273ab2699e6-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-843870c7-00a2-477c-8fee-8273ab2699e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-quobyte-843870c7-00a2-477c-8fee-8273ab2699e6" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-843870c7-00a2-477c-8fee-8273ab2699e6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Deleting offline snapshot 843870c7-00a2-477c-8fee-8273ab2699e6 of volume b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] snapshot_file for this snap is: volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b260100-8fa2-4000-8d27-822dbc7e6b0e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (01f9e8be-a627-484e-8186-d6c70fe82f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc9dfb1-1a3d-44d5-bdc4-f480e41ca1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc9dfb1-1a3d-44d5-bdc4-f480e41ca1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537037360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014be6b6-2fb3-4ec0-9337-f85068374bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:55Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2609162-ad2b-4f2a-8f86-b9b86ff7a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2609162-ad2b-4f2a-8f86-b9b86ff7a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49c00d7-dee7-40fd-97a6-0dbf4e1936dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6
Jun 17 04:18:55 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49c00d7-dee7-40fd-97a6-0dbf4e1936dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014be6b6-2fb3-4ec0-9337-f85068374bcf', 'volume_name': 'volume-014be6b6-2fb3-4ec0-9337-f85068374bcf', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd2c2c-3bc6-4879-b347-c8e57dabab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd2c2c-3bc6-4879-b347-c8e57dabab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd699b97-331f-4f26-80e8-ff4d5f4a229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume 014be6b6-2fb3-4ec0-9337-f85068374bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014be6b6-2fb3-4ec0-9337-f85068374bcf', 'volume_size': 1}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (96c566c9-6848-4d14-b9d7-9ef48e35ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dc2143-4ead-40a6-8efc-781700b72464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dc2143-4ead-40a6-8efc-781700b72464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227255578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4786bba-a073-4d55-8711-6ac6588654af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:56Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f78f6e-0eef-4c32-8564-118ff681c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f78f6e-0eef-4c32-8564-118ff681c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484719ca-08fe-4ef6-84d7-3d079baf0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484719ca-08fe-4ef6-84d7-3d079baf0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4786bba-a073-4d55-8711-6ac6588654af', 'volume_name': 'volume-a4786bba-a073-4d55-8711-6ac6588654af', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687e3af8-64d9-49b7-a089-ff76d4a4eb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687e3af8-64d9-49b7-a089-ff76d4a4eb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f7b9e7-e657-4d27-9f5a-3d8240da5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume a4786bba-a073-4d55-8711-6ac6588654af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4786bba-a073-4d55-8711-6ac6588654af', 'volume_size': 1}
Jun 17 04:18:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (77363153-8e04-4ccc-bd60-df2b062102ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7e8680-3b17-4020-a97f-a21929d21b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7e8680-3b17-4020-a97f-a21929d21b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417049809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36039fe9-937a-47c9-8b9d-7892006a4bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:56Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3385863c-d545-41a6-9ab4-3ce49ac9ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3385863c-d545-41a6-9ab4-3ce49ac9ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6e0dc5-419b-4449-9caa-231fdab33ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6e0dc5-419b-4449-9caa-231fdab33ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36039fe9-937a-47c9-8b9d-7892006a4bf8', 'volume_name': 'volume-36039fe9-937a-47c9-8b9d-7892006a4bf8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afd3461-f99c-441c-a5b4-3ac6dc2c626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afd3461-f99c-441c-a5b4-3ac6dc2c626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707ee53f-713c-452d-8539-6837fefc3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume 36039fe9-937a-47c9-8b9d-7892006a4bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36039fe9-937a-47c9-8b9d-7892006a4bf8', 'volume_size': 1}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:56 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c 1073741824" returned: 0 in 1.299s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:56 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c
Jun 17 04:18:56 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (1b0562a4-e95d-40d5-a006-06dc34c46a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fac4043-fb21-432c-955b-77f5189095a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6" returned: 0 in 1.374s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b93b46-37be-4adf-bc2f-c2ee294f452c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fac4043-fb21-432c-955b-77f5189095a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-826568751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f8ac01-8e59-4b1e-85c4-91f51f7c0812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:57Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530dcc26-b25f-4f6d-9d97-ec169128ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530dcc26-b25f-4f6d-9d97-ec169128ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e6616f-48c7-4bce-b3cf-06a0473679be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e6616f-48c7-4bce-b3cf-06a0473679be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f8ac01-8e59-4b1e-85c4-91f51f7c0812', 'volume_name': 'volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a755a5e-f4f8-4d9a-b56f-f3740f263805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a755a5e-f4f8-4d9a-b56f-f3740f263805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eb5160-a0b9-4c1d-832f-70a258eff10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:56 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume b8f8ac01-8e59-4b1e-85c4-91f51f7c0812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812', 'volume_size': 1}
Jun 17 04:18:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:56 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:18:56 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:57 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c" returned: 0 in 0.810s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537037360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014be6b6-2fb3-4ec0-9337-f85068374bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:55Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume 014be6b6-2fb3-4ec0-9337-f85068374bcf {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:57 devstack sudo[108548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf 1073741824
Jun 17 04:18:57 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffbbb99-3c95-450d-abe5-f24264bb2252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d42cc6-7170-4733-ace7-ff60320ef42c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d802b8-4f82-4159-ac84-c4d257377a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-b4d42cc6-7170-4733-ace7-ff60320ef42c (b4d42cc6-7170-4733-ace7-ff60320ef42c): created successfully
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d802b8-4f82-4159-ac84-c4d257377a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (28a57e01-7e66-4e5d-90f3-939ab56ba295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-43a6ddf6-332e-4095-a68d-f0693947343e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:18:57 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 0.777s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:57 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6
Jun 17 04:18:57 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:57 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf 1073741824" returned: 0 in 0.863s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:57 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf
Jun 17 04:18:57 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:58 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:58 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6
Jun 17 04:18:58 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:58 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227255578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4786bba-a073-4d55-8711-6ac6588654af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:56Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume a4786bba-a073-4d55-8711-6ac6588654af {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:58 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd699b97-331f-4f26-80e8-ff4d5f4a229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014be6b6-2fb3-4ec0-9337-f85068374bcf', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:58 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af 1073741824
Jun 17 04:18:58 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf56c5e9-5a2b-4981-8870-ee071e8c5f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:18:58 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-014be6b6-2fb3-4ec0-9337-f85068374bcf (014be6b6-2fb3-4ec0-9337-f85068374bcf): created successfully
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf56c5e9-5a2b-4981-8870-ee071e8c5f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (01f9e8be-a627-484e-8186-d6c70fe82f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:18:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f0e44011-d69a-4011-aa3e-534e20a35de7 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:18:58 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3.843870c7-00a2-477c-8fee-8273ab2699e6" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-843870c7-00a2-477c-8fee-8273ab2699e6" released by "_delete_snapshot" :: held 3.622s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" released by "delete_snapshot" :: held 3.652s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Created reservations ['b67846ce-d394-4721-9793-15b7c7d60aad', '9fe31e17-b813-4fdc-8223-fd1d7fb23f97', 'b53cf1bd-a6ef-4b97-a6ff-58dfeabf69ae', '9acc6dbd-f8b8-490a-a256-5c67866bec31'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:18:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Delete snapshot completed successfully.
Jun 17 04:18:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3277cddb-3dec-4ab2-9e20-ff7687064b60 tempest-VolumesExtendTest-1324742537 None] Lock "cinder-843870c7-00a2-477c-8fee-8273ab2699e6-delete_snapshot" released by "delete_snapshot" :: held 3.794s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:18:59 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af 1073741824" returned: 0 in 0.767s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:59 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af
Jun 17 04:18:59 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-b9c2d8d1-979f-4bb4-88af-442d4eac45f3-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "cinder-b9c2d8d1-979f-4bb4-88af-442d4eac45f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Acquiring lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[43105b5a-3c5b-4db0-937e-14a5553f0068]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:18:59 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:18:59 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:18:59 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af" returned: 0 in 0.594s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.767s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417049809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36039fe9-937a-47c9-8b9d-7892006a4bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:56Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume 36039fe9-937a-47c9-8b9d-7892006a4bf8 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:18:59 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:18:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:00 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 1073741824
Jun 17 04:19:00 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f7b9e7-e657-4d27-9f5a-3d8240da5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4786bba-a073-4d55-8711-6ac6588654af', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800d7674-3297-4b1d-a2ab-8852c35029ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:00 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-a4786bba-a073-4d55-8711-6ac6588654af (a4786bba-a073-4d55-8711-6ac6588654af): created successfully
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800d7674-3297-4b1d-a2ab-8852c35029ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (96c566c9-6848-4d14-b9d7-9ef48e35ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6644887c-7529-4304-8c76-4ebbabfb6dff tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:19:00 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:00 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3
Jun 17 04:19:00 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:00 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 1073741824" returned: 0 in 0.775s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:00 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8
Jun 17 04:19:00 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:00 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" returned: 0 in 0.602s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "cinder-quobyte-b9c2d8d1-979f-4bb4-88af-442d4eac45f3" released by "delete_volume" :: held 1.376s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:00 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Created reservations ['857916c5-6fc7-413e-b3d3-52cd53011928', '631556d9-2775-430f-9565-3480ae90a2fa', '39c53f6e-b724-454a-8e5f-b19cd9c31213', 'affea09b-aefd-4b00-a3b2-a6fed6ac1687'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:01 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:01 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:01 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8" returned: 0 in 0.595s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.639s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-826568751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f8ac01-8e59-4b1e-85c4-91f51f7c0812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eadcfa2b4c482da6b43b75314201ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:18:57Z,use_quota=True,user_id='bce981a5daa14702988a05afd99f1d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Creating volume b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:01 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707ee53f-713c-452d-8539-6837fefc3895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36039fe9-937a-47c9-8b9d-7892006a4bf8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:01 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 1073741824
Jun 17 04:19:01 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d585561-8971-4303-a1fb-357e5b724527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:01 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 (36039fe9-937a-47c9-8b9d-7892006a4bf8): created successfully
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d585561-8971-4303-a1fb-357e5b724527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (77363153-8e04-4ccc-bd60-df2b062102ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2ff5f611-f5ef-4b39-97a1-874d0659683e tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:19:01 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Deleted volume successfully.
Jun 17 04:19:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1658534-3e99-4fb8-8d57-c09fb3bcdccf tempest-VolumesExtendTest-1324742537 None] Lock "cinder-b9c2d8d1-979f-4bb4-88af-442d4eac45f3-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:02 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:02 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:02 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 1073741824" returned: 0 in 0.868s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:02 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812
Jun 17 04:19:02 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:02 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:19:02 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" returned: 0 in 0.654s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eb5160-a0b9-4c1d-832f-70a258eff10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe02f6ef-39ec-477c-b006-d0ddb8169b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:03 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Volume volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 (b8f8ac01-8e59-4b1e-85c4-91f51f7c0812): created successfully
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe02f6ef-39ec-477c-b006-d0ddb8169b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Flow 'volume_create_manager' (1b0562a4-e95d-40d5-a006-06dc34c46a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f9007ad4-9d49-4610-9a9e-cd0ee6e0f7a2 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created volume successfully.
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe80be0-e945-4780-aecd-132b1f483cb0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:03 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812
Jun 17 04:19:03 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:04 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:04 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812
Jun 17 04:19:04 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (60ddaf34-9e8d-4c8e-9aa4-758743c4ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f500474-a721-497d-954a-bf496b3cac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f500474-a721-497d-954a-bf496b3cac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-213032625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ec7ea3-c972-49b9-94c2-12763d7c297e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:05Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b4ea4c-db46-49fa-874c-1bd4e44957f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b4ea4c-db46-49fa-874c-1bd4e44957f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c82399-edb7-4b8b-938d-f5f206fc7380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c82399-edb7-4b8b-938d-f5f206fc7380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ec7ea3-c972-49b9-94c2-12763d7c297e', 'volume_name': 'volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5581805-fa00-4d50-ab98-3ce47048f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5581805-fa00-4d50-ab98-3ce47048f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d548d7a-b745-4bc8-a944-80af176c82e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Volume d4ec7ea3-c972-49b9-94c2-12763d7c297e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e', 'volume_size': 1}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-213032625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ec7ea3-c972-49b9-94c2-12763d7c297e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:05Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Creating volume d4ec7ea3-c972-49b9-94c2-12763d7c297e {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:04 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:04 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:04 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e 1073741824
Jun 17 04:19:04 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812" released by "delete_volume" :: held 1.377s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['0bbbf47f-6abd-4367-842f-48b045785123', '2de3c400-3662-487f-b9ce-2dcdd40168d8', '2a28cd88-9e71-413b-bb9b-9ee70c2e8025', '9a1a8271-ac5c-41fb-978d-dcdc35ab08a7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:04 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:04 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:05 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.590s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:05 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-12c105aa-2811-4ac9-b1d4-505bad90f4ee tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b8f8ac01-8e59-4b1e-85c4-91f51f7c0812-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e 1073741824" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-36039fe9-937a-47c9-8b9d-7892006a4bf8-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:05 devstack sudo[108624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e
Jun 17 04:19:05 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-36039fe9-937a-47c9-8b9d-7892006a4bf8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-36039fe9-937a-47c9-8b9d-7892006a4bf8" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-36039fe9-937a-47c9-8b9d-7892006a4bf8" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ce02c-dd37-4bb3-99f0-b79ae43d3fb8]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:05 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8
Jun 17 04:19:05 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:06 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e" returned: 0 in 0.611s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d548d7a-b745-4bc8-a944-80af176c82e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372afe82-de6c-4e91-bfee-25223de151ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:06 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Volume volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e (d4ec7ea3-c972-49b9-94c2-12763d7c297e): created successfully
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372afe82-de6c-4e91-bfee-25223de151ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (60ddaf34-9e8d-4c8e-9aa4-758743c4ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9d45b2d6-f2aa-4d76-985d-f73abe22390d tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:06 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:06 devstack sudo[108633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8
Jun 17 04:19:06 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:06 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-36039fe9-937a-47c9-8b9d-7892006a4bf8" returned: 0 in 0.602s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-36039fe9-937a-47c9-8b9d-7892006a4bf8" released by "delete_volume" :: held 1.361s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['a85d375e-9795-4989-8edd-8f6efd18e7c8', '83887694-7a96-4264-890f-23b5563c3a03', 'd7902139-5e49-4be0-b7d1-e96275154756', 'b325d976-de6c-4698-8418-eea3fb286654'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:07 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:07 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (55c54ec4-a793-400d-be5f-f1acbf908059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c600ab9-1804-47dd-bc94-c8b755636037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c600ab9-1804-47dd-bc94-c8b755636037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1508115369',display_name='tempest-VolumesGetTest-Volume-1867518631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf531ec4-29de-4118-ba58-3859b70afe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:07Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9c7825-1376-4f1b-af8a-e31b89d43d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9c7825-1376-4f1b-af8a-e31b89d43d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa192de-3133-435d-bce3-81a4f0da1507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa192de-3133-435d-bce3-81a4f0da1507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf531ec4-29de-4118-ba58-3859b70afe4c', 'volume_name': 'volume-bf531ec4-29de-4118-ba58-3859b70afe4c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7a141e-518c-4635-bb8e-7998b9d25803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7a141e-518c-4635-bb8e-7998b9d25803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50f4b3e-efed-48ca-b5ab-14ab9d2f4e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:07 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Volume bf531ec4-29de-4118-ba58-3859b70afe4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf531ec4-29de-4118-ba58-3859b70afe4c', 'volume_size': 1}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1508115369',display_name='tempest-VolumesGetTest-Volume-1867518631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf531ec4-29de-4118-ba58-3859b70afe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:07Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Creating volume bf531ec4-29de-4118-ba58-3859b70afe4c {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:07 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:07 devstack sudo[108638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c 1073741824
Jun 17 04:19:07 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:07 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-a4786bba-a073-4d55-8711-6ac6588654af-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ab0f71bc-1357-4993-966a-2714fdb22e9f tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-36039fe9-937a-47c9-8b9d-7892006a4bf8-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-a4786bba-a073-4d55-8711-6ac6588654af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-a4786bba-a073-4d55-8711-6ac6588654af" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-a4786bba-a073-4d55-8711-6ac6588654af" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc6823c-6809-4ffb-920e-3c512ff70c59]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:07 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af
Jun 17 04:19:08 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:08 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c 1073741824" returned: 0 in 0.788s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:08 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c
Jun 17 04:19:08 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:08 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af" returned: 0 in 0.765s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:08 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af
Jun 17 04:19:08 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:08 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c" returned: 0 in 0.638s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50f4b3e-efed-48ca-b5ab-14ab9d2f4e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf531ec4-29de-4118-ba58-3859b70afe4c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be0b435-63ee-4ee5-a2de-b4304d1ee14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:08 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Volume volume-bf531ec4-29de-4118-ba58-3859b70afe4c (bf531ec4-29de-4118-ba58-3859b70afe4c): created successfully
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be0b435-63ee-4ee5-a2de-b4304d1ee14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:08 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (55c54ec4-a793-400d-be5f-f1acbf908059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d2f8cae9-df96-4e8e-ab92-057b174236f7 tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:09 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-a4786bba-a073-4d55-8711-6ac6588654af" returned: 0 in 0.649s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-a4786bba-a073-4d55-8711-6ac6588654af" released by "delete_volume" :: held 1.461s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['0343bf08-1bbf-4d37-8160-899b0468586d', '453f367d-ecfc-4cfb-8f71-cb5f06a23850', '570b97f9-74d2-4863-a8f3-963df42c92d4', 'dd3aea27-768a-4951-a716-d26800a4b97e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:09 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:09 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-bf531ec4-29de-4118-ba58-3859b70afe4c-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "cinder-bf531ec4-29de-4118-ba58-3859b70afe4c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-bf531ec4-29de-4118-ba58-3859b70afe4c" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-bf531ec4-29de-4118-ba58-3859b70afe4c" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb0875-80f6-4278-ade6-46e579d9d286]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:09 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c
Jun 17 04:19:09 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-014be6b6-2fb3-4ec0-9337-f85068374bcf-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-014be6b6-2fb3-4ec0-9337-f85068374bcf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:10 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.687s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-014be6b6-2fb3-4ec0-9337-f85068374bcf" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-014be6b6-2fb3-4ec0-9337-f85068374bcf" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a2105487-a271-4d5c-8355-660d6ff0b9bd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-a4786bba-a073-4d55-8711-6ac6588654af-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e881d7-f1ab-4401-9198-689802b42a8c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:10 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf
Jun 17 04:19:10 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:10 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c" returned: 0 in 0.818s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:10 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c
Jun 17 04:19:10 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:10 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf" returned: 0 in 0.745s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:10 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf
Jun 17 04:19:10 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:11 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bf531ec4-29de-4118-ba58-3859b70afe4c" returned: 0 in 0.661s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-bf531ec4-29de-4118-ba58-3859b70afe4c" released by "delete_volume" :: held 1.535s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Created reservations ['4fd14aa6-aec1-460a-874f-f0f9be93c5d9', '5072e798-b53c-4f9a-b0b6-a06619c0cb04', '90259084-1409-423f-ac0f-63025c4c41b3', '99feca9d-2121-4498-94ca-86b7612404d7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:11 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:11 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:11 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-014be6b6-2fb3-4ec0-9337-f85068374bcf" returned: 0 in 0.611s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-014be6b6-2fb3-4ec0-9337-f85068374bcf" released by "delete_volume" :: held 1.405s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['c736d8a2-8e1b-4021-bb52-5b855be3c79e', 'f293e6d7-63b9-4260-bd33-4050aceeec3b', '06a757c8-fa5a-4a7f-88ec-93f89adfc945', '24beb0c6-a8b0-4792-b669-a904864d3e7b'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:11 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:11 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-d4ec7ea3-c972-49b9-94c2-12763d7c297e-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-d4ec7ea3-c972-49b9-94c2-12763d7c297e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:11 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-d4ec7ea3-c972-49b9-94c2-12763d7c297e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.651s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-d4ec7ea3-c972-49b9-94c2-12763d7c297e" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[50538705-1a0f-4de3-90ee-4205c3dd8f94]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c58b362-391c-4ee7-a893-dbafef062968 tempest-VolumesGetTest-2125183511 None] Lock "cinder-bf531ec4-29de-4118-ba58-3859b70afe4c-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:12 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e
Jun 17 04:19:12 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-b4d42cc6-7170-4733-ace7-ff60320ef42c-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b4d42cc6-7170-4733-ace7-ff60320ef42c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:12 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.653s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:12 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-b4d42cc6-7170-4733-ace7-ff60320ef42c" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-de713332-950b-45c1-92cb-c3fa539b9540 tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-014be6b6-2fb3-4ec0-9337-f85068374bcf-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b4d42cc6-7170-4733-ace7-ff60320ef42c" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6500a0-7184-4885-b106-ada1a6568d11]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:12 devstack sudo[108686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c
Jun 17 04:19:12 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:12 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e" returned: 0 in 0.782s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:12 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e
Jun 17 04:19:12 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:13 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:13 devstack sudo[108696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c
Jun 17 04:19:13 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:13 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d4ec7ea3-c972-49b9-94c2-12763d7c297e" returned: 0 in 0.606s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-d4ec7ea3-c972-49b9-94c2-12763d7c297e" released by "delete_volume" :: held 1.439s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Created reservations ['80276f44-119d-4a7b-ba89-1f35cad444a7', '4c03a8ac-5652-4cb4-903e-3d11c81f36e9', '3e9ffd47-cb9c-4756-86b0-8df3849d8b2e', 'e39aeca7-bd4c-4da7-98ff-3eea9babdcc3'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:13 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:13 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:13 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b4d42cc6-7170-4733-ace7-ff60320ef42c" returned: 0 in 0.644s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b4d42cc6-7170-4733-ace7-ff60320ef42c" released by "delete_volume" :: held 1.405s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['6bf4f265-6799-40d7-a1cf-96556922e270', '09acbd29-bf38-43e3-9761-605ee9d481e7', '2befdbd2-bca4-4b97-945b-ee5375f9e075', 'aecfffce-ba22-43c9-b579-aa733581eac5'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:13 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:13 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:14 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.629s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-38f8e4f1-da2b-40c5-b1c3-c7b2e39438b9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-d4ec7ea3-c972-49b9-94c2-12763d7c297e-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5bfdc5-af65-44d0-a4bd-43f2660b6ff2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:14 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec
Jun 17 04:19:14 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (dcc07388-2c63-4994-9b5d-31e78cb0d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebeba97-5411-42ac-8b95-be5a4b9375ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:14 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-b56710b4-d243-4ae6-b9ea-c47951ccbf4f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.706s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebeba97-5411-42ac-8b95-be5a4b9375ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1628566548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:15Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11451c6-d773-4fae-8e05-ad0ab7cd276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11451c6-d773-4fae-8e05-ad0ab7cd276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046f5b2-72d9-46b6-9ab2-16cf6f6e252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046f5b2-72d9-46b6-9ab2-16cf6f6e252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'volume_name': 'volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbee9000-65c1-4917-a0bd-b1702334cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbee9000-65c1-4917-a0bd-b1702334cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573f6a86-0e13-4ffe-89f5-81428a2deee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:14 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Volume 0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'volume_size': 1}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b56710b4-d243-4ae6-b9ea-c47951ccbf4f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-aa109938-e927-46d2-8ba0-644dad7b67ef tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b4d42cc6-7170-4733-ace7-ff60320ef42c-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "cinder-quobyte-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32a676-facf-4f0a-9377-72ec26a5ec47]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:14 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f
Jun 17 04:19:14 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:15 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec" returned: 0 in 0.796s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1628566548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:15Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Creating volume 0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:15 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:15 devstack sudo[108721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a 1073741824
Jun 17 04:19:15 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd', 'name': 'volume-79971efb-fe29-4182-a993-a52f5ca547ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1219346-b178-4e7b-9ebf-c912a468cc5e', 'enforce_multipath': True} {{(pid=92204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 17 04:19:15 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-63ddb01a-d8ba-422b-8e1e-ae80deabf336 req-dbdcf3e9-ea48-434f-b307-2c459419571a tempest-TestStampPattern-564531214 None] attachment_update completed successfully.
Jun 17 04:19:15 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:15 devstack sudo[108791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f
Jun 17 04:19:15 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:16 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a 1073741824" returned: 0 in 0.874s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:16 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:16 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:16 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" returned: 0 in 0.643s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-quobyte-b56710b4-d243-4ae6-b9ea-c47951ccbf4f" released by "delete_volume" :: held 1.402s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Created reservations ['343bab8b-c350-436e-866d-1b64bdb705f6', '8b89d8b2-530b-402a-8789-0c049d03be33', '4d50290a-93a4-432c-bd74-0a58b122c751', '157777ce-84bb-42cf-abc7-c0028ca9f91a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:16 devstack sudo[109118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:16 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:16 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.651s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573f6a86-0e13-4ffe-89f5-81428a2deee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7960682d-4376-4470-839a-af9502f53fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:16 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Volume volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a (0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a): created successfully
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7960682d-4376-4470-839a-af9502f53fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (dcc07388-2c63-4994-9b5d-31e78cb0d441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3bbb9e0a-62ea-43fd-bbbf-bb1bee535e6d tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:16 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.645s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:16 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Deleted volume successfully.
Jun 17 04:19:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-635e310b-d742-4de9-b62b-1059bd5c88dd tempest-CreateVolumesFromSourceVolumeTest-627079477 None] Lock "cinder-b56710b4-d243-4ae6-b9ea-c47951ccbf4f-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (c18937e1-1a42-4441-9dfb-bbc0fafb648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0db8d12-439b-4c82-9caf-5461f860ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0db8d12-439b-4c82-9caf-5461f860ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-907046838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b2f926-354a-4755-9794-40cf41960f1f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:18Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a1a77-7413-464e-8c32-d3189e580f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a1a77-7413-464e-8c32-d3189e580f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2a6c3-fad4-4624-a3a6-00d3caf28971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2a6c3-fad4-4624-a3a6-00d3caf28971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '98b2f926-354a-4755-9794-40cf41960f1f', 'volume_name': 'volume-98b2f926-354a-4755-9794-40cf41960f1f', 'volume_size': 1, 'source_volid': '0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'source_volstatus': 'available'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ff04c-3647-4f4a-be08-eacee318299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ff04c-3647-4f4a-be08-eacee318299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1efa044-26ca-4b5d-8cf9-8f7a95048fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Volume 98b2f926-354a-4755-9794-40cf41960f1f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-98b2f926-354a-4755-9794-40cf41960f1f', 'volume_size': 1, 'source_volid': '0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'source_volstatus': 'available'}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:18 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Cloning volume 0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a to volume 98b2f926-354a-4755-9794-40cf41960f1f
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Creating offline snapshot 13a650a8-c9dd-4b89-a073-024e0d566475 of volume 0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5fca5-4a2e-495b-bfb0-447bc8a2127f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:18 devstack sudo[109123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:18 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:19 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.781s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:19 devstack sudo[109130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 1G
Jun 17 04:19:19 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Flow 'volume_create_manager' (757526f9-96f9-4147-a3a0-922599d2938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1932e206-c794-4932-9be5-22cef57c782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1932e206-c794-4932-9be5-22cef57c782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a80e680-caca-45fa-a689-558c66239857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f042943e67486a899b2c755e3afc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:20Z,use_quota=True,user_id='d0d3fe7660804b8cba8489ec7f4991ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86496d0-1271-43c0-b180-1939931f85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86496d0-1271-43c0-b180-1939931f85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd427f8-4c5c-4c66-980e-bd87d58ecdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd427f8-4c5c-4c66-980e-bd87d58ecdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a80e680-caca-45fa-a689-558c66239857', 'volume_name': 'volume-5a80e680-caca-45fa-a689-558c66239857', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baf8454-fe0f-47c8-88eb-e68fdde5da06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baf8454-fe0f-47c8-88eb-e68fdde5da06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbcecc9-66b5-421d-9088-bfac9d620152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Volume 5a80e680-caca-45fa-a689-558c66239857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a80e680-caca-45fa-a689-558c66239857', 'volume_size': 1}
Jun 17 04:19:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:20 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 1G" returned: 0 in 0.830s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:20 devstack sudo[109149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:20 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:20 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.661s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:20 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 is being set with open permissions: ugo+rw
Jun 17 04:19:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:20 devstack sudo[109154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:20 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:21 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:21 devstack sudo[109157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info
Jun 17 04:19:21 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:21 devstack cinder-volume[92204]: INFO cinder.volume.manager [req-28ef3876-261a-4dfc-a14c-6601257d3a41 req-b1dd1cf7-956d-4c70-b4f5-1a059a366914 tempest-TestStampPattern-564531214 None] Terminate volume connection completed successfully.
Jun 17 04:19:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [req-28ef3876-261a-4dfc-a14c-6601257d3a41 req-b1dd1cf7-956d-4c70-b4f5-1a059a366914 tempest-TestStampPattern-564531214 None] Deleting attachment c1219346-b178-4e7b-9ebf-c912a468cc5e. {{(pid=92204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 17 04:19:21 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info" returned: 0 in 0.657s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:21 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info is being set with open permissions: ugo+rw
Jun 17 04:19:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:22 devstack sudo[109187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info
Jun 17 04:19:22 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:22 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.info" returned: 0 in 0.610s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] snapshot: 13a650a8-c9dd-4b89-a073-024e0d566475, volume: 98b2f926-354a-4755-9794-40cf41960f1f,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a0786-d5ec-4490-a2ba-3f56c99675c4]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:22 devstack sudo[109190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:22 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:23 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1b757-1b24-41dd-b97d-6d0452a07605]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:23 devstack sudo[109195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:23 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:24 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:24 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:19:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:24 devstack sudo[109201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f
Jun 17 04:19:24 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:29 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f" returned: 0 in 5.588s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9455d1b-bdaf-4a6f-9141-46529668d8a3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:29 devstack sudo[109259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:29 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:30 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.876s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:30 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:19:30 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Converted 1024.00 MB image at 183.22 MB/s
Jun 17 04:19:30 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f is being set with open permissions: ugo+rw
Jun 17 04:19:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:30 devstack sudo[109265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f
Jun 17 04:19:30 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:31 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" released by "_copy_volume_from_snapshot" :: held 8.545s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-13a650a8-c9dd-4b89-a073-024e0d566475" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-13a650a8-c9dd-4b89-a073-024e0d566475" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Deleting offline snapshot 13a650a8-c9dd-4b89-a073-024e0d566475 of volume 0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] snapshot_file for this snap is: volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc2ee86-08af-4712-a85a-1d74cbdccf17]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:31 devstack sudo[109268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:31 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=85,cinder:UPDATE=100,cinder:INSERT=28,cinder:DELETE=9 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-79971efb-fe29-4182-a993-a52f5ca547ec-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "cinder-79971efb-fe29-4182-a993-a52f5ca547ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eae61f-dc2e-4986-ad8e-9ebd58e20955]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:31 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec
Jun 17 04:19:31 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:31 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.766s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d8414-e18e-41a0-adba-ac7f430d5840]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:32 devstack sudo[109275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:32 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:32 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:32 devstack sudo[109281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec
Jun 17 04:19:32 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:32 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.808s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:32 devstack sudo[109286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:32 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:33 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-79971efb-fe29-4182-a993-a52f5ca547ec" returned: 0 in 0.650s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-79971efb-fe29-4182-a993-a52f5ca547ec" released by "delete_volume" :: held 1.480s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Created reservations ['bfacf024-b3e3-4c14-a455-4b920567174c', 'ec6be4a4-2d27-4635-acf7-9a01fe2b4ac8', 'bb66eb3e-f60d-4e99-9d76-ca1d5aca507c', '1b9447b0-9e14-4610-af5e-e23ffede7197'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:33 devstack sudo[109298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:33 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:33 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:33 devstack sudo[109301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475
Jun 17 04:19:33 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:34 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.660s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Deleted volume successfully.
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-42a56674-35dc-43b5-ab13-5bb035080ae8 tempest-TestStampPattern-564531214 None] Lock "cinder-79971efb-fe29-4182-a993-a52f5ca547ec-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:34 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a.13a650a8-c9dd-4b89-a073-024e0d566475" returned: 0 in 0.676s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-13a650a8-c9dd-4b89-a073-024e0d566475" released by "_delete_snapshot" :: held 3.153s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Deleting offline snapshot 1ca766a8-3d87-4ba0-bf32-1978b85b48d7 of volume 859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] snapshot_file for this snap is: volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.697s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a80e680-caca-45fa-a689-558c66239857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f042943e67486a899b2c755e3afc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:20Z,use_quota=True,user_id='d0d3fe7660804b8cba8489ec7f4991ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Creating volume 5a80e680-caca-45fa-a689-558c66239857 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:34 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cba7f4-d3bd-4b8a-ab12-d2ffe0870d36]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:34 devstack sudo[109305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 1073741824
Jun 17 04:19:34 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1efa044-26ca-4b5d-8cf9-8f7a95048fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b2f926-354a-4755-9794-40cf41960f1f', 'volume_size': 1, 'source_volid': '0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a', 'source_volstatus': 'available'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fae4046-19c4-41f7-9f0e-b6e3c0077b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:34 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Volume volume-98b2f926-354a-4755-9794-40cf41960f1f (98b2f926-354a-4755-9794-40cf41960f1f): created successfully
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fae4046-19c4-41f7-9f0e-b6e3c0077b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (c18937e1-1a42-4441-9dfb-bbc0fafb648b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b3f55f6f-4b6e-46ef-b5a4-1f8fdd17e360 tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:34 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:19:34 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:35 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.792s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859de878-2d02-4790-a22f-13e2b226bedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:19:35 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 1073741824" returned: 0 in 0.850s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[55920436-220a-4c25-9960-86d8ffde3557]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (87defd20-5e7c-4dd2-ae90-5e46da6bec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fd586b-bd81-4704-9a0d-84c8b8746d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fd586b-bd81-4704-9a0d-84c8b8746d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-802650260',display_name='tempest-VolumesGetTest-Volume-197356824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a7611-6867-4dad-84df-940dff4c6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:35Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:35 devstack sudo[109316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:19:35 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:35 devstack sudo[109317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc520426-f5db-4104-9f66-ef65ca04b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:35 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc520426-f5db-4104-9f66-ef65ca04b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d8a6ca-e436-46f1-9c52-7f52b22a69a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d8a6ca-e436-46f1-9c52-7f52b22a69a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8a7611-6867-4dad-84df-940dff4c6fb7', 'volume_name': 'volume-0c8a7611-6867-4dad-84df-940dff4c6fb7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9867770e-865f-494c-adaa-352883633494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9867770e-865f-494c-adaa-352883633494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ffb9ca-1d21-487b-a3fa-90475f8cd0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Volume 0c8a7611-6867-4dad-84df-940dff4c6fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8a7611-6867-4dad-84df-940dff4c6fb7', 'volume_size': 1}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:35 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.700s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:36 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857" returned: 0 in 0.621s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-802650260',display_name='tempest-VolumesGetTest-Volume-197356824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a7611-6867-4dad-84df-940dff4c6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:35Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Creating volume 0c8a7611-6867-4dad-84df-940dff4c6fb7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:36 devstack sudo[109326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:19:36 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:36 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbcecc9-66b5-421d-9088-bfac9d620152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a80e680-caca-45fa-a689-558c66239857', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:36 devstack sudo[109328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 1073741824
Jun 17 04:19:36 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84452261-6853-4470-8c9c-b384ed274344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Volume volume-5a80e680-caca-45fa-a689-558c66239857 (5a80e680-caca-45fa-a689-558c66239857): created successfully
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84452261-6853-4470-8c9c-b384ed274344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Flow 'volume_create_manager' (757526f9-96f9-4147-a3a0-922599d2938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:36 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-767a8049-6493-4fb3-91f1-34a35848d716 tempest-CinderUnicodeTest-196076361 None] Created volume successfully.
Jun 17 04:19:36 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:36 devstack sudo[109338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7
Jun 17 04:19:36 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:36 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 1073741824" returned: 0 in 0.753s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:36 devstack sudo[109340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7
Jun 17 04:19:36 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:37 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc.1ca766a8-3d87-4ba0-bf32-1978b85b48d7" returned: 0 in 0.581s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-1ca766a8-3d87-4ba0-bf32-1978b85b48d7" released by "_delete_snapshot" :: held 2.989s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" released by "delete_snapshot" :: held 3.026s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:37 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7" returned: 0 in 0.676s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ffb9ca-1d21-487b-a3fa-90475f8cd0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8a7611-6867-4dad-84df-940dff4c6fb7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23e6496-9d5e-4fd2-8b8d-a35412b5b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Volume volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 (0c8a7611-6867-4dad-84df-940dff4c6fb7): created successfully
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23e6496-9d5e-4fd2-8b8d-a35412b5b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (87defd20-5e7c-4dd2-ae90-5e46da6bec06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Created reservations ['e5e5b34f-2792-470d-8034-8570d6c34aba', 'e3246bcc-3314-455c-945e-7708d0b1a00b', '212dda34-8550-4e1e-9839-e652bf529f1d', 'd9b0a803-10ab-4d8b-9d89-dfc7563dab22'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4270b1b9-8a64-4df0-bf90-d2816e0f5587 tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Flow 'volume_create_manager' (adaf3e38-650a-4663-a8bf-17c7d830b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f23ad6-2f16-4a35-8701-94c55465aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f23ad6-2f16-4a35-8701-94c55465aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-250398600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de99384-4041-4b85-b12b-dfd344478df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f042943e67486a899b2c755e3afc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:38Z,use_quota=True,user_id='d0d3fe7660804b8cba8489ec7f4991ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceb4f84-29b6-4c02-9fd4-ad46d768828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceb4f84-29b6-4c02-9fd4-ad46d768828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed84478f-e760-4070-b30d-13c1a6c4f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed84478f-e760-4070-b30d-13c1a6c4f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de99384-4041-4b85-b12b-dfd344478df8', 'volume_name': 'volume-8de99384-4041-4b85-b12b-dfd344478df8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807757d2-d08e-4dc6-9c47-c698001e49c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807757d2-d08e-4dc6-9c47-c698001e49c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd7c3ff-5c0e-43a8-9975-5cdac667256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Volume 8de99384-4041-4b85-b12b-dfd344478df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de99384-4041-4b85-b12b-dfd344478df8', 'volume_size': 1}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-250398600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de99384-4041-4b85-b12b-dfd344478df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f042943e67486a899b2c755e3afc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:38Z,use_quota=True,user_id='d0d3fe7660804b8cba8489ec7f4991ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Creating volume 8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:37 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:37 devstack sudo[109344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 1073741824
Jun 17 04:19:37 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Delete snapshot completed successfully.
Jun 17 04:19:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-655cfaa2-f2ef-4632-8da9-80f0d16437a7 tempest-TestStampPattern-564531214 None] Lock "cinder-1ca766a8-3d87-4ba0-bf32-1978b85b48d7-delete_snapshot" released by "delete_snapshot" :: held 3.370s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:38 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 1073741824" returned: 0 in 0.762s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:38 devstack sudo[109349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8
Jun 17 04:19:38 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-0c8a7611-6867-4dad-84df-940dff4c6fb7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "cinder-0c8a7611-6867-4dad-84df-940dff4c6fb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-0c8a7611-6867-4dad-84df-940dff4c6fb7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-0c8a7611-6867-4dad-84df-940dff4c6fb7" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f490f5d-4570-4aa7-a3f4-f13bd426e674]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:38 devstack sudo[109351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7
Jun 17 04:19:38 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:39 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8" returned: 0 in 0.689s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd7c3ff-5c0e-43a8-9975-5cdac667256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de99384-4041-4b85-b12b-dfd344478df8', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e5a316-baeb-43aa-8c1f-c0d5cb946e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:39 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Volume volume-8de99384-4041-4b85-b12b-dfd344478df8 (8de99384-4041-4b85-b12b-dfd344478df8): created successfully
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e5a316-baeb-43aa-8c1f-c0d5cb946e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Flow 'volume_create_manager' (adaf3e38-650a-4663-a8bf-17c7d830b29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ebbeb500-8e69-4619-b5e1-66926ececa79 tempest-CinderUnicodeTest-196076361 None] Created volume successfully.
Jun 17 04:19:39 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7" returned: 0 in 0.830s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:39 devstack sudo[109359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7
Jun 17 04:19:39 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Creating offline snapshot 6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 of volume 8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[97860191-2903-46bb-9dd6-2eae8ae1e0a2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:40 devstack sudo[109361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8
Jun 17 04:19:40 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:40 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0c8a7611-6867-4dad-84df-940dff4c6fb7" returned: 0 in 0.678s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-0c8a7611-6867-4dad-84df-940dff4c6fb7" released by "delete_volume" :: held 1.566s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Created reservations ['eafd83b3-a590-480c-a323-ebf6ca253fa1', 'e19c948c-8ba1-41f3-a79b-69db917ca811', '94db6d1d-b31e-4ae8-82bd-126a6329f43f', '74ca67dd-2fb4-4695-a29a-2df4e5f45c47'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:40 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:40 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:41 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8" returned: 0 in 1.006s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:41 devstack sudo[109407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 1G
Jun 17 04:19:41 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-98b2f926-354a-4755-9794-40cf41960f1f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "cinder-98b2f926-354a-4755-9794-40cf41960f1f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293256d-0b03-4578-b3a8-2be211ee87ed]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:41 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-e56d9fc0-fda9-4e11-bdd6-41ab907ff8e7 tempest-VolumesGetTest-2125183511 None] Lock "cinder-0c8a7611-6867-4dad-84df-940dff4c6fb7-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:41 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f
Jun 17 04:19:41 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:41 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 1G" returned: 0 in 0.888s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8de99384-4041-4b85-b12b-dfd344478df8 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:41 devstack sudo[109418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8de99384-4041-4b85-b12b-dfd344478df8 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9
Jun 17 04:19:41 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:42 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f" returned: 0 in 0.829s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:42 devstack sudo[109421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f
Jun 17 04:19:42 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:42 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8de99384-4041-4b85-b12b-dfd344478df8 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" returned: 0 in 0.706s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:42 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 is being set with open permissions: ugo+rw
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:42 devstack sudo[109427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9
Jun 17 04:19:42 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:42 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-98b2f926-354a-4755-9794-40cf41960f1f" returned: 0 in 0.690s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-98b2f926-354a-4755-9794-40cf41960f1f" released by "delete_volume" :: held 1.578s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Created reservations ['f2c9a42f-21a3-4b72-8df5-a2b157145d02', '5f89b50e-0d51-414a-be1d-736d67f075b0', 'a76d6662-f4e2-4b8b-a32e-f966f16bcd0d', 'd446f6b9-1ed4-453d-a280-92535d7e8589'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:42 devstack sudo[109430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:42 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:43 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:43 devstack sudo[109433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info
Jun 17 04:19:43 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:43 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.617s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8bec2a25-9cee-45ad-82af-fa2a97c22463 tempest-VolumesGetTest-2125183511 None] Lock "cinder-98b2f926-354a-4755-9794-40cf41960f1f-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0175511-aff0-475f-ae41-89f7e22d60aa]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:43 devstack sudo[109436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:43 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:43 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info" returned: 0 in 0.642s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:43 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info is being set with open permissions: ugo+rw
Jun 17 04:19:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:44 devstack sudo[109439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info
Jun 17 04:19:44 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:44 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.727s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:44 devstack sudo[109444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a
Jun 17 04:19:44 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:44 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.info" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.585s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a988d1e2-4793-4c7b-9a5e-c233333a0042 tempest-CinderUnicodeTest-196076361 None] Create snapshot completed successfully
Jun 17 04:19:44 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a" released by "delete_volume" :: held 1.398s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Created reservations ['a1ca2374-5357-4135-b5ef-4794155dd17f', '506dc455-f863-44b1-9a75-5f7c34f6179d', '690f592e-5333-4c2d-9cb8-f5381362828c', 'a8936278-e962-4a27-bfd9-1327e0d177aa'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:45 devstack sudo[109448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:45 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-quobyte-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Deleting offline snapshot 6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 of volume 8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] snapshot_file for this snap is: volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f3b492-e537-4026-8599-356317338418]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:45 devstack sudo[109450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9
Jun 17 04:19:45 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:45 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.648s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:45 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:19:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5d103a22-95d8-48fc-a668-bea392cb50a9 tempest-VolumesGetTest-2125183511 None] Lock "cinder-0fa6229b-2c9a-4684-8032-c9cc9fe4eb9a-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-859de878-2d02-4790-a22f-13e2b226bedc-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:46 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8de99384-4041-4b85-b12b-dfd344478df8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "cinder-859de878-2d02-4790-a22f-13e2b226bedc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebb5deb-a1a6-45cb-acfd-d3536d74bca0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Acquiring lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea1121-0188-4648-8ad6-d53f564b701a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:46 devstack sudo[109458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8
Jun 17 04:19:46 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:46 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:19:46 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (5950a19f-9233-449a-b670-316bdee04fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f800791a-2126-465f-9c0b-9db6fe3960dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f800791a-2126-465f-9c0b-9db6fe3960dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1834293294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501f2059-3554-4344-b2c5-be0d0dbae1b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:47Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc94971-4275-4902-8960-0c7cd3c8e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc94971-4275-4902-8960-0c7cd3c8e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43736d2a-c124-4892-b629-ce32a43981d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:19:46 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:46 devstack sudo[109467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9
Jun 17 04:19:46 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43736d2a-c124-4892-b629-ce32a43981d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '501f2059-3554-4344-b2c5-be0d0dbae1b0', 'volume_name': 'volume-501f2059-3554-4344-b2c5-be0d0dbae1b0', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b61b2c0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4272ce-be7e-4bd1-b095-3e68a5061165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4272ce-be7e-4bd1-b095-3e68a5061165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec900c6-d5ee-4ce5-ad00-d7762e76f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:47 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Volume 501f2059-3554-4344-b2c5-be0d0dbae1b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-501f2059-3554-4344-b2c5-be0d0dbae1b0', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b61b2c0>}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Trying to clone 501f2059-3554-4344-b2c5-be0d0dbae1b0 from image 6b933bbd-ad87-411f-8a67-3350ca673beb at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:19:47 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.838s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:47 devstack sudo[109471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc
Jun 17 04:19:47 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:19:47 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Image download 20.69 MB at 20.69 MB/s
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[70455c1e-0cdb-4616-a48e-a9dcc42914ea]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:47 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD
Jun 17 04:19:47 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:47 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" returned: 0 in 0.760s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:47 devstack sudo[109480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9
Jun 17 04:19:47 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:47 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-859de878-2d02-4790-a22f-13e2b226bedc" returned: 0 in 0.654s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "cinder-quobyte-859de878-2d02-4790-a22f-13e2b226bedc" released by "delete_volume" :: held 1.580s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Created reservations ['d6d169fc-85f1-4466-b447-89a0c797f273', 'cb6d3116-22d8-466a-bfd7-ab216ec92908', '8ecefee2-7946-4292-a929-36d49a6dc044', '240c63f4-597f-4393-8662-9a3f7619514a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:47 devstack sudo[109482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:47 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:48 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb is fetched for user 033e61a692fe43f98a7b86a3367f5687. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236309a-d22e-4e2c-bcd1-b128376f63be]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:48 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8.6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" returned: 0 in 0.657s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:48 devstack sudo[109488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD
Jun 17 04:19:48 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9" released by "_delete_snapshot" :: held 3.082s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" released by "delete_snapshot" :: held 3.113s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Created reservations ['64cbbccf-8400-40fa-9799-c4477d884590', '1b59e9fa-abfc-4d60-b982-851a2c2fe1ed', 'd14c64c7-faba-4eeb-8f3b-b9eadce58922', '76226047-decb-4465-a7f9-7afe9b6c9cc3'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:48 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.638s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:48 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Delete snapshot completed successfully.
Jun 17 04:19:48 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Deleted volume successfully.
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-57120520-af75-4d1a-8c5d-7be2be2e9f49 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-6c3cacd6-e4fa-4311-8e33-0525ab2bd1a9-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2c9a2ec6-5b82-42ff-b43a-ef52c08175df tempest-TestStampPattern-564531214 None] Lock "cinder-859de878-2d02-4790-a22f-13e2b226bedc-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:48 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1834293294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501f2059-3554-4344-b2c5-be0d0dbae1b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:47Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Creating volume 501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:49 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:49 devstack sudo[109494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1073741824
Jun 17 04:19:49 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-8de99384-4041-4b85-b12b-dfd344478df8-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-8de99384-4041-4b85-b12b-dfd344478df8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73e028-2637-4770-ac31-1b7e3234be93]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:49 devstack sudo[109499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8
Jun 17 04:19:49 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:49 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1073741824" returned: 0 in 0.875s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:49 devstack sudo[109502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:19:49 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:50 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8" returned: 0 in 0.743s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:50 devstack sudo[109544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8
Jun 17 04:19:50 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:50 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 0 in 0.639s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:DELETE=13,cinder:SELECT=130,cinder:UPDATE=196,cinder:INSERT=42 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Attempting download of 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume 501f2059-3554-4344-b2c5-be0d0dbae1b0. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02de0f9-dc68-485e-a5be-352f748ea1df]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:50 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd
Jun 17 04:19:50 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:51 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-8de99384-4041-4b85-b12b-dfd344478df8" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-8de99384-4041-4b85-b12b-dfd344478df8" released by "delete_volume" :: held 1.538s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Created reservations ['ee01d616-6e3b-44e1-9857-f28fb629ae9c', '7ceee6bb-0f00-4c3e-8105-b5032b9fd958', 'c5dee649-eb41-40d2-8d33-66b22184bc11', '10be0636-8c86-42e7-b4f4-ad5d2eaf35ab'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:51 devstack sudo[109550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:51 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:51 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd" returned: 0 in 0.743s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:51 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd
Jun 17 04:19:51 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-5a80e680-caca-45fa-a689-558c66239857-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-5a80e680-caca-45fa-a689-558c66239857-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "cinder-quobyte-5a80e680-caca-45fa-a689-558c66239857" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:19:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-5a80e680-caca-45fa-a689-558c66239857" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:19:52 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.724s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Deleted volume successfully.
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff1546-2783-4db2-a6b3-e51c621c7067]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-223d2767-8df4-4c92-bc19-ab852e7eaa09 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-8de99384-4041-4b85-b12b-dfd344478df8-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:52 devstack sudo[109557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857
Jun 17 04:19:52 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:52 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd" returned: 1 in 0.848s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b933bbd-ad87-411f-8a67-3350ca673beb_cs6wg9vd' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadc038d-b4c6-440d-b2ee-95289f4f2da0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:52 devstack sudo[109561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD
Jun 17 04:19:52 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:52 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857" returned: 0 in 0.782s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:52 devstack sudo[109566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857
Jun 17 04:19:52 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:53 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] 6b933bbd-ad87-411f-8a67-3350ca673beb was qcow2, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:53 devstack sudo[109571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:19:53 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:53 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5a80e680-caca-45fa-a689-558c66239857" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-quobyte-5a80e680-caca-45fa-a689-558c66239857" released by "delete_volume" :: held 1.543s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Created reservations ['4125d92d-b2c7-499b-a28e-8df2c93354e4', '4de62a54-d425-42be-b760-1d62a3732481', '4e680071-23d9-4e62-90e4-d87e2b26adb8', '8af07aa8-1503-401c-a07a-78d533402f5c'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:53 devstack sudo[109578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:19:53 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:54 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:54 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:19:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Deleted volume successfully.
Jun 17 04:19:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7e684aee-f78f-4438-a7b3-c7195ef1d513 tempest-CinderUnicodeTest-196076361 None] Lock "cinder-5a80e680-caca-45fa-a689-558c66239857-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:19:55 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 0 in 2.130s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:55 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b933bbd-ad87-411f-8a67-3350ca673beb_j1ov50oudevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:19:55 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Converted 112.00 MB image at 52.55 MB/s
Jun 17 04:19:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:55 devstack sudo[109587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1G
Jun 17 04:19:55 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:55 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 1G" returned: 0 in 0.774s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a89e0e1-162d-4836-acd2-c5c1b749e7fe]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:19:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:56 devstack sudo[109593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:19:56 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:56 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:56 devstack sudo[109597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:19:56 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:19:57 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 1 in 0.749s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Downloaded image 6b933bbd-ad87-411f-8a67-3350ca673beb ((None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}])) to volume 501f2059-3554-4344-b2c5-be0d0dbae1b0 successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Temporary image 6b933bbd-ad87-411f-8a67-3350ca673beb for user 033e61a692fe43f98a7b86a3367f5687 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Marking volume 501f2059-3554-4344-b2c5-be0d0dbae1b0 as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Copying metadata from image 6b933bbd-ad87-411f-8a67-3350ca673beb to 501f2059-3554-4344-b2c5-be0d0dbae1b0. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Creating volume glance metadata for volume 501f2059-3554-4344-b2c5-be0d0dbae1b0 backed by image 6b933bbd-ad87-411f-8a67-3350ca673beb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec900c6-d5ee-4ce5-ad00-d7762e76f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501f2059-3554-4344-b2c5-be0d0dbae1b0', 'volume_size': 1, 'image_id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b933bbd-ad87-411f-8a67-3350ca673beb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cccbf187270409d877ecb38cb9a3a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b933bbd-ad87-411f-8a67-3350ca673beb', 'created_at': datetime.datetime(2026, 6, 17, 1, 56, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 1, 56, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b933bbd-ad87-411f-8a67-3350ca673beb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b61b2c0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0d8caf-4e6d-41d6-ac0e-c91b1384f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Volume volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 (501f2059-3554-4344-b2c5-be0d0dbae1b0): created successfully
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0d8caf-4e6d-41d6-ac0e-c91b1384f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (5950a19f-9233-449a-b670-316bdee04fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a2d3516d-3650-45a9-87ec-5499d79248e4 tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (148aee6c-a060-45d9-a230-8c9e0981176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f659c6f-cf59-4c44-a6b2-46a7dd3b1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f659c6f-cf59-4c44-a6b2-46a7dd3b1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-546785915',display_name='tempest-VolumesGetTest-Volume-1780982621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e19838-d645-4bd3-9d19-68416bef7c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:59Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8606afb9-a505-462c-b867-ea29575e8ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8606afb9-a505-462c-b867-ea29575e8ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537455d6-a020-4bc6-a5fc-d5447bf7d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537455d6-a020-4bc6-a5fc-d5447bf7d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e19838-d645-4bd3-9d19-68416bef7c30', 'volume_name': 'volume-66e19838-d645-4bd3-9d19-68416bef7c30', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2562a6de-dd40-435f-b9e6-8b3fbd050f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2562a6de-dd40-435f-b9e6-8b3fbd050f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63598869-1a37-4fd2-b2f8-ace7d78d7036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:19:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Volume 66e19838-d645-4bd3-9d19-68416bef7c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e19838-d645-4bd3-9d19-68416bef7c30', 'volume_size': 1}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:19:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-546785915',display_name='tempest-VolumesGetTest-Volume-1780982621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e19838-d645-4bd3-9d19-68416bef7c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a286001b3c834088bc8e002e658c18b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:19:59Z,use_quota=True,user_id='033e61a692fe43f98a7b86a3367f5687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Creating volume 66e19838-d645-4bd3-9d19-68416bef7c30 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:19:59 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:19:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:19:59 devstack sudo[109605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 1073741824
Jun 17 04:19:59 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:00 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 1073741824" returned: 0 in 0.808s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:00 devstack sudo[109612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30
Jun 17 04:20:00 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:00 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30" returned: 0 in 0.590s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63598869-1a37-4fd2-b2f8-ace7d78d7036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e19838-d645-4bd3-9d19-68416bef7c30', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad0fb13-e3da-4321-8407-e6ad250b3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:00 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Volume volume-66e19838-d645-4bd3-9d19-68416bef7c30 (66e19838-d645-4bd3-9d19-68416bef7c30): created successfully
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad0fb13-e3da-4321-8407-e6ad250b3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:00 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Flow 'volume_create_manager' (148aee6c-a060-45d9-a230-8c9e0981176e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e4b1e2e1-0787-42a4-aea3-44fe75d91923 tempest-VolumesGetTest-2125183511 None] Created volume successfully.
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-66e19838-d645-4bd3-9d19-68416bef7c30-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "cinder-66e19838-d645-4bd3-9d19-68416bef7c30-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-66e19838-d645-4bd3-9d19-68416bef7c30" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-66e19838-d645-4bd3-9d19-68416bef7c30" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc7cbb-9272-41ad-9018-68b6f55732e2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:01 devstack sudo[109616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30
Jun 17 04:20:01 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:02 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30" returned: 0 in 0.711s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:02 devstack sudo[109621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:02 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:02 devstack sudo[109622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30
Jun 17 04:20:02 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:02 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.612s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:20:02 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-66e19838-d645-4bd3-9d19-68416bef7c30" returned: 0 in 0.648s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-66e19838-d645-4bd3-9d19-68416bef7c30" released by "delete_volume" :: held 1.404s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:02 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Created reservations ['16c4c5dc-4ede-4a2b-b3ed-932e6a261c90', '86dc3c79-3f7f-44b8-a19f-d0db2fbd623f', 'e5aa33dd-30b1-46e5-97be-1d70cc70c4f8', 'b217b3d1-3090-4e2b-aacb-efff8f16edf1'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:03 devstack sudo[109627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:03 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Flow 'volume_create_manager' (e5b71685-5f1b-4873-b39f-67a23f64287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e297470e-370c-4da7-94fc-99d41e7575e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e297470e-370c-4da7-94fc-99d41e7575e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db96724e-e564-44aa-a8e7-0f2bd543e2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bd74e49a64b74b7ce910d6d983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:03Z,use_quota=True,user_id='a788da50c0d14328a1e19d3cbbb38b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82423f89-e17e-4454-9dd6-ae9c7b7e61ce),volume_type_id=82423f89-e17e-4454-9dd6-ae9c7b7e61ce)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3363eff0-61e0-4154-95b0-9e17ae9b196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3363eff0-61e0-4154-95b0-9e17ae9b196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522f538c-e6f4-47b1-97e1-e65c38c3876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:20:03 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.601s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d7427e81-287c-44b8-ab6f-9c3dd6ef67fa tempest-VolumesGetTest-2125183511 None] Lock "cinder-66e19838-d645-4bd3-9d19-68416bef7c30-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-501f2059-3554-4344-b2c5-be0d0dbae1b0-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "cinder-501f2059-3554-4344-b2c5-be0d0dbae1b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Acquiring lock "cinder-quobyte-501f2059-3554-4344-b2c5-be0d0dbae1b0" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-501f2059-3554-4344-b2c5-be0d0dbae1b0" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522f538c-e6f4-47b1-97e1-e65c38c3876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db96724e-e564-44aa-a8e7-0f2bd543e2ee', 'volume_name': 'volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee', 'volume_size': 1, 'image_id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430f9f0c4e40f0ca2043b23472e78517', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e08bd74e49a64b74b7ce910d6d983bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cda17eba5f79644e7102ab9e49b6cef983c1f38208412185b6d3b65e215f659da8473c40ecc4cb2e8a0878f3c1b9564f8583c8a4c3c0e46c13635f3e7defd63', 'id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'created_at': datetime.datetime(2026, 6, 17, 2, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 20, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3c7440>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c081a6-7967-40f2-94ee-9302af25fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c081a6-7967-40f2-94ee-9302af25fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb077733-270b-4575-be55-d6c5fed793bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:03 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Volume db96724e-e564-44aa-a8e7-0f2bd543e2ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee', 'volume_size': 1, 'image_id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430f9f0c4e40f0ca2043b23472e78517', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e08bd74e49a64b74b7ce910d6d983bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cda17eba5f79644e7102ab9e49b6cef983c1f38208412185b6d3b65e215f659da8473c40ecc4cb2e8a0878f3c1b9564f8583c8a4c3c0e46c13635f3e7defd63', 'id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'created_at': datetime.datetime(2026, 6, 17, 2, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 20, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3c7440>}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Trying to clone db96724e-e564-44aa-a8e7-0f2bd543e2ee from image c1f087d0-8c41-4eea-84ec-ac8794cba9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1df35-501c-48e3-bc75-6935467fce63]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:03 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:20:03 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Image download 0.00 MB at 0.00 MB/s
Jun 17 04:20:03 devstack sudo[109630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:20:03 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b992648-810a-460d-83cd-ad6b73422f32]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:04 devstack sudo[109632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:04 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:04 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 0 in 0.701s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:04 devstack sudo[109636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:20:04 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:04 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:04 devstack sudo[109640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:04 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:05 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 1 in 0.684s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:05 devstack sudo[109648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0
Jun 17 04:20:05 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:05 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 1 in 0.660s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Temporary image c1f087d0-8c41-4eea-84ec-ac8794cba9fd is fetched for user a788da50c0d14328a1e19d3cbbb38b22. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a9429e-11a5-404d-bbc0-0e4818e974f5]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:05 devstack sudo[109650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:05 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:05 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-501f2059-3554-4344-b2c5-be0d0dbae1b0" returned: 0 in 0.583s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "cinder-quobyte-501f2059-3554-4344-b2c5-be0d0dbae1b0" released by "delete_volume" :: held 2.061s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Created reservations ['f881a497-7119-4a7b-8ce9-aa58ffb5bc31', '1dad7241-f71d-4edf-9c92-5fc900d3a3b8', '2d17dca8-81b2-4745-9367-c56f715cf65a', '2be385c6-7ed4-4903-8cd6-07c7032e6bb7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:06 devstack sudo[109654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:06 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:06 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:06 devstack sudo[109658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:06 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:06 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.584s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Deleted volume successfully.
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1ce65689-4fdd-4444-96ff-1db73914ce5b tempest-VolumesGetTest-2125183511 None] Lock "cinder-501f2059-3554-4344-b2c5-be0d0dbae1b0-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:06 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 1 in 0.659s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db96724e-e564-44aa-a8e7-0f2bd543e2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bd74e49a64b74b7ce910d6d983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:03Z,use_quota=True,user_id='a788da50c0d14328a1e19d3cbbb38b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82423f89-e17e-4454-9dd6-ae9c7b7e61ce),volume_type_id=82423f89-e17e-4454-9dd6-ae9c7b7e61ce)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Creating volume db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:06 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:06 devstack sudo[109664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1073741824
Jun 17 04:20:06 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:07 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1073741824" returned: 0 in 0.787s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:07 devstack sudo[109670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:07 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:08 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 0 in 0.626s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Attempting download of c1f087d0-8c41-4eea-84ec-ac8794cba9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}])) to volume db96724e-e564-44aa-a8e7-0f2bd543e2ee. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7cf86-b709-4cf4-bb86-c4b9c620e7d8]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:08 devstack sudo[109673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r
Jun 17 04:20:08 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:08 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:09 devstack sudo[109677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r
Jun 17 04:20:09 devstack sudo[109677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:09 devstack sudo[109677]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r" returned: 1 in 0.715s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_mi5q3x3r' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:09 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8027df86-44af-401a-8713-17ed2b702151]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:09 devstack sudo[109681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:09 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:10 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:10 devstack sudo[109685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD
Jun 17 04:20:10 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:11 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD" returned: 1 in 0.671s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] c1f087d0-8c41-4eea-84ec-ac8794cba9fd was raw, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:11 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:11 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:11 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 0 in 0.703s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1f087d0-8c41-4eea-84ec-ac8794cba9fd_4v4007nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:20:11 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Converted 0.00 MB image at 0.00 MB/s
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:11 devstack sudo[109695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1G
Jun 17 04:20:11 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Flow 'volume_create_manager' (57829be7-eeca-4cf9-82c2-33a50fd7c389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae8c616-452d-4361-a273-07885562e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae8c616-452d-4361-a273-07885562e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1248625275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301feaf-9a79-44dd-a831-0368c881a5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f61ca1a65e748bd8338782f27b110dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:12Z,use_quota=True,user_id='a01be2c1e1dc4cf2b2647f9494b63fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e02f388-d5f9-460c-9d0b-0582f4321f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e02f388-d5f9-460c-9d0b-0582f4321f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee7cde3-5dbd-403a-88f7-3df38ec5b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee7cde3-5dbd-403a-88f7-3df38ec5b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1301feaf-9a79-44dd-a831-0368c881a5b9', 'volume_name': 'volume-1301feaf-9a79-44dd-a831-0368c881a5b9', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701d5768-6b4f-4eef-84bf-c63efa8ca8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701d5768-6b4f-4eef-84bf-c63efa8ca8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a3ea91-b472-4625-838a-a08943239ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:12 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Volume 1301feaf-9a79-44dd-a831-0368c881a5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1301feaf-9a79-44dd-a831-0368c881a5b9', 'volume_size': 1}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1248625275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301feaf-9a79-44dd-a831-0368c881a5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f61ca1a65e748bd8338782f27b110dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:12Z,use_quota=True,user_id='a01be2c1e1dc4cf2b2647f9494b63fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Creating volume 1301feaf-9a79-44dd-a831-0368c881a5b9 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:12 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:12 devstack sudo[109697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 1073741824
Jun 17 04:20:12 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:12 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee 1G" returned: 0 in 0.653s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25be1c-6ae9-45e3-bee8-49fe84ef08e4]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:12 devstack sudo[109702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:12 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:12 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 1073741824" returned: 0 in 0.765s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:12 devstack sudo[109708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9
Jun 17 04:20:12 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:13 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 0 in 0.694s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:13 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:13 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:13 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9" returned: 0 in 0.654s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a3ea91-b472-4625-838a-a08943239ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1301feaf-9a79-44dd-a831-0368c881a5b9', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c466f24-db39-4f41-bd08-1587d87212fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Volume volume-1301feaf-9a79-44dd-a831-0368c881a5b9 (1301feaf-9a79-44dd-a831-0368c881a5b9): created successfully
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c466f24-db39-4f41-bd08-1587d87212fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Flow 'volume_create_manager' (57829be7-eeca-4cf9-82c2-33a50fd7c389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4476b8f2-a0de-4a4f-8c32-2707dd91a2d0 tempest-VolumesNegativeTest-1267022022 None] Created volume successfully.
Jun 17 04:20:13 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 1 in 0.703s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Downloaded image c1f087d0-8c41-4eea-84ec-ac8794cba9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}])) to volume db96724e-e564-44aa-a8e7-0f2bd543e2ee successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Temporary image c1f087d0-8c41-4eea-84ec-ac8794cba9fd for user a788da50c0d14328a1e19d3cbbb38b22 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Marking volume db96724e-e564-44aa-a8e7-0f2bd543e2ee as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Copying metadata from image c1f087d0-8c41-4eea-84ec-ac8794cba9fd to db96724e-e564-44aa-a8e7-0f2bd543e2ee. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Creating volume glance metadata for volume db96724e-e564-44aa-a8e7-0f2bd543e2ee backed by image c1f087d0-8c41-4eea-84ec-ac8794cba9fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '430f9f0c4e40f0ca2043b23472e78517', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb077733-270b-4575-be55-d6c5fed793bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee', 'volume_size': 1, 'image_id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430f9f0c4e40f0ca2043b23472e78517', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e08bd74e49a64b74b7ce910d6d983bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cda17eba5f79644e7102ab9e49b6cef983c1f38208412185b6d3b65e215f659da8473c40ecc4cb2e8a0878f3c1b9564f8583c8a4c3c0e46c13635f3e7defd63', 'id': 'c1f087d0-8c41-4eea-84ec-ac8794cba9fd', 'created_at': datetime.datetime(2026, 6, 17, 2, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 20, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1f087d0-8c41-4eea-84ec-ac8794cba9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b3c7440>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61655560-d90b-4fc6-a4b1-c868ac853d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Volume volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee (db96724e-e564-44aa-a8e7-0f2bd543e2ee): created successfully
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61655560-d90b-4fc6-a4b1-c868ac853d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Flow 'volume_create_manager' (e5b71685-5f1b-4873-b39f-67a23f64287e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4fc6b2fb-9bd8-4db3-a0fc-dfc8bc89dd24 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Created volume successfully.
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Acquiring lock "cinder-db96724e-e564-44aa-a8e7-0f2bd543e2ee-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "cinder-db96724e-e564-44aa-a8e7-0f2bd543e2ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Acquiring lock "cinder-quobyte-db96724e-e564-44aa-a8e7-0f2bd543e2ee" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "cinder-quobyte-db96724e-e564-44aa-a8e7-0f2bd543e2ee" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[014dcd35-fab1-4f1c-9fdf-b768787dff5d]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:14 devstack sudo[109718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:14 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:15 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 0 in 0.708s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:15 devstack sudo[109724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:15 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:15 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 1 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:20:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:15 devstack sudo[109729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee
Jun 17 04:20:15 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:16 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-db96724e-e564-44aa-a8e7-0f2bd543e2ee" returned: 0 in 0.586s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "cinder-quobyte-db96724e-e564-44aa-a8e7-0f2bd543e2ee" released by "delete_volume" :: held 2.096s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:16 devstack cinder-volume[92204]: WARNING cinder.quota [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:20:16 devstack cinder-volume[92204]: WARNING cinder.quota [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Created reservations ['bfce195c-ede8-42cf-a7c4-c5e6ac01ed6e', 'bb7cabfc-8df2-415d-bec4-e1f38efecef6', 'ef72a09c-a6cd-4935-b31e-ac6a089499f0', '24288bab-bbec-43b8-b531-aa37ea9b6012'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:16 devstack sudo[109733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:16 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:17 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:17 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:17 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Deleted volume successfully.
Jun 17 04:20:17 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4d311de7-0e57-4c07-a0b7-04adeaf2a419 tempest-VolumeAndVolumeTypeFromImageTest-189353415 None] Lock "cinder-db96724e-e564-44aa-a8e7-0f2bd543e2ee-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (3e8f6ee3-5f9e-4ccb-9577-79db39794e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a05ea7-cd9a-4c08-8fe8-3de47479d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a05ea7-cd9a-4c08-8fe8-3de47479d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635828239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dcc9af-a4e4-4cd9-8c88-6be468a763fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04654f-8abb-4f81-8331-0ab9018a2c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04654f-8abb-4f81-8331-0ab9018a2c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ac1382-09ae-45d9-8c4e-c6bcb63d1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ac1382-09ae-45d9-8c4e-c6bcb63d1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dcc9af-a4e4-4cd9-8c88-6be468a763fc', 'volume_name': 'volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77c5159-862d-4ce5-8281-b1fbd17de1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77c5159-862d-4ce5-8281-b1fbd17de1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813783a5-bf53-4327-beb6-d9a8c80d2856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Volume 34dcc9af-a4e4-4cd9-8c88-6be468a763fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc', 'volume_size': 1}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635828239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dcc9af-a4e4-4cd9-8c88-6be468a763fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Creating volume 34dcc9af-a4e4-4cd9-8c88-6be468a763fc {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:21 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:21 devstack sudo[109754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc 1073741824
Jun 17 04:20:21 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (91f590e5-37db-4215-91c9-4e00a98f24ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2349e571-9ada-4b28-837c-f0fd8df36d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2349e571-9ada-4b28-837c-f0fd8df36d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547356100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03887bc1-aaec-4bba-8d83-f00b39046efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e12d1-e7b5-4463-9c29-21d849b8c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e12d1-e7b5-4463-9c29-21d849b8c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d0855b-65c5-466e-a11c-ca4dee2551b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d0855b-65c5-466e-a11c-ca4dee2551b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03887bc1-aaec-4bba-8d83-f00b39046efb', 'volume_name': 'volume-03887bc1-aaec-4bba-8d83-f00b39046efb', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb7686c-a634-488e-be14-d08b8d2427fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb7686c-a634-488e-be14-d08b8d2427fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d62873-2a24-417e-b809-93b1112b277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Volume 03887bc1-aaec-4bba-8d83-f00b39046efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03887bc1-aaec-4bba-8d83-f00b39046efb', 'volume_size': 1}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (7d4b7758-18ad-48b6-8d64-9ad1c9d83b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae742143-84a8-4360-a214-4ac0df042070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae742143-84a8-4360-a214-4ac0df042070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797118153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67994214-b4f9-4a07-a7ff-3ec61df7d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b81493-518a-4fa5-8079-56eb7a9edc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b81493-518a-4fa5-8079-56eb7a9edc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af600dce-b388-426b-aa9b-ee240e6ff267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af600dce-b388-426b-aa9b-ee240e6ff267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67994214-b4f9-4a07-a7ff-3ec61df7d3f6', 'volume_name': 'volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f1db6f-3edd-4d86-95e0-188498f7d3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f1db6f-3edd-4d86-95e0-188498f7d3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ade19-55cb-4b25-87ab-8fc48f4a834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Volume 67994214-b4f9-4a07-a7ff-3ec61df7d3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6', 'volume_size': 1}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:22 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc 1073741824" returned: 0 in 0.913s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (0de663bb-fc2b-42bb-89d9-02058fc7aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f9a6f-7529-448d-ab85-123317fc5cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f9a6f-7529-448d-ab85-123317fc5cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-357710020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5bad7-8593-4811-bd23-a988e9907844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:23Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c03a75-3dda-4772-91ac-4bf084776f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c03a75-3dda-4772-91ac-4bf084776f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71905dcb-bb4c-4129-8fba-4ab59ee5e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71905dcb-bb4c-4129-8fba-4ab59ee5e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a5bad7-8593-4811-bd23-a988e9907844', 'volume_name': 'volume-27a5bad7-8593-4811-bd23-a988e9907844', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3be06f8-05ea-4145-bd05-8a4191f322f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3be06f8-05ea-4145-bd05-8a4191f322f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f200123-1583-4897-8750-adb6ffd3d1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Volume 27a5bad7-8593-4811-bd23-a988e9907844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a5bad7-8593-4811-bd23-a988e9907844', 'volume_size': 1}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:23 devstack sudo[109760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc
Jun 17 04:20:23 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (ee352cc7-cd31-45d8-adbc-b677cdc117fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59d1ed5-649c-4af3-90bb-4c3e652e05f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59d1ed5-649c-4af3-90bb-4c3e652e05f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671044519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa978963-6e73-4cd5-b332-920a7aaa8d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:23Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3404d8-2c88-4056-b22c-c78688debba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3404d8-2c88-4056-b22c-c78688debba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d075edf-474b-467e-a8b7-1d07d2d39911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d075edf-474b-467e-a8b7-1d07d2d39911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa978963-6e73-4cd5-b332-920a7aaa8d9d', 'volume_name': 'volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ceb690-9b16-462d-85b4-1ff47124acf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ceb690-9b16-462d-85b4-1ff47124acf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0327e5-6d06-4120-a7ae-ea727b4192d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Volume aa978963-6e73-4cd5-b332-920a7aaa8d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d', 'volume_size': 1}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:23 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" returned: 0 in 0.640s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547356100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03887bc1-aaec-4bba-8d83-f00b39046efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Creating volume 03887bc1-aaec-4bba-8d83-f00b39046efb {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:23 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813783a5-bf53-4327-beb6-d9a8c80d2856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack sudo[109763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb 1073741824
Jun 17 04:20:23 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29537a34-ac69-49e8-8ef5-f9ce8e960288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Volume volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc (34dcc9af-a4e4-4cd9-8c88-6be468a763fc): created successfully
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29537a34-ac69-49e8-8ef5-f9ce8e960288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (3e8f6ee3-5f9e-4ccb-9577-79db39794e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5a0df739-4117-46ab-a326-6b3e9f5a6d44 tempest-CreateVolumesFromImageTest-1189584817 None] Created volume successfully.
Jun 17 04:20:24 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb 1073741824" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:24 devstack sudo[109769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb
Jun 17 04:20:24 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:25 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.492s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797118153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67994214-b4f9-4a07-a7ff-3ec61df7d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:22Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Creating volume 67994214-b4f9-4a07-a7ff-3ec61df7d3f6 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:25 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:25 devstack sudo[109776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 1073741824
Jun 17 04:20:25 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d62873-2a24-417e-b809-93b1112b277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03887bc1-aaec-4bba-8d83-f00b39046efb', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75e96-a1cc-4aa8-a9cd-823d2907d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Volume volume-03887bc1-aaec-4bba-8d83-f00b39046efb (03887bc1-aaec-4bba-8d83-f00b39046efb): created successfully
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75e96-a1cc-4aa8-a9cd-823d2907d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (91f590e5-37db-4215-91c9-4e00a98f24ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-78ea5a60-7ab3-4840-8994-86aef8ff8ce1 tempest-CreateVolumesFromImageTest-1189584817 None] Created volume successfully.
Jun 17 04:20:25 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 1073741824" returned: 0 in 0.763s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:25 devstack sudo[109781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6
Jun 17 04:20:25 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:26 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" returned: 0 in 0.769s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-357710020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5bad7-8593-4811-bd23-a988e9907844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:23Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Creating volume 27a5bad7-8593-4811-bd23-a988e9907844 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:26 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:26 devstack sudo[109838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 1073741824
Jun 17 04:20:26 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ade19-55cb-4b25-87ab-8fc48f4a834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e57105-84d9-432f-8798-06758ac92b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:26 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Volume volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 (67994214-b4f9-4a07-a7ff-3ec61df7d3f6): created successfully
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e57105-84d9-432f-8798-06758ac92b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:26 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (7d4b7758-18ad-48b6-8d64-9ad1c9d83b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-24ccb0c8-7444-4e42-bd62-a581329606a8 tempest-CreateVolumesFromImageTest-1189584817 None] Created volume successfully.
Jun 17 04:20:27 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 1073741824" returned: 0 in 0.917s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:27 devstack sudo[109854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844
Jun 17 04:20:27 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:28 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.930s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671044519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa978963-6e73-4cd5-b332-920a7aaa8d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044ed8d7db164490bf4a288908f2922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:23Z,use_quota=True,user_id='5bb7ed5d7deb4033933c68a8303314ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Creating volume aa978963-6e73-4cd5-b332-920a7aaa8d9d {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:28 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f200123-1583-4897-8750-adb6ffd3d1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a5bad7-8593-4811-bd23-a988e9907844', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b0799-dc5a-4b51-8380-7819c717e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:28 devstack sudo[109857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d 1073741824
Jun 17 04:20:28 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Volume volume-27a5bad7-8593-4811-bd23-a988e9907844 (27a5bad7-8593-4811-bd23-a988e9907844): created successfully
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b0799-dc5a-4b51-8380-7819c717e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (0de663bb-fc2b-42bb-89d9-02058fc7aa94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0ea7cdc7-0e74-439b-b78b-f689e5fbfb39 tempest-CreateVolumesFromImageTest-1189584817 None] Created volume successfully.
Jun 17 04:20:29 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d 1073741824" returned: 0 in 0.845s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:29 devstack sudo[109864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d
Jun 17 04:20:29 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:29 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d" returned: 0 in 0.641s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0327e5-6d06-4120-a7ae-ea727b4192d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a98374-8778-4cf7-84f5-6757b62966f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Volume volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d (aa978963-6e73-4cd5-b332-920a7aaa8d9d): created successfully
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a98374-8778-4cf7-84f5-6757b62966f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Flow 'volume_create_manager' (ee352cc7-cd31-45d8-adbc-b677cdc117fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:29 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4e9eec76-4c8b-46bc-8ad6-ffcc2931a510 tempest-CreateVolumesFromImageTest-1189584817 None] Created volume successfully.
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-aa978963-6e73-4cd5-b332-920a7aaa8d9d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-aa978963-6e73-4cd5-b332-920a7aaa8d9d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-quobyte-aa978963-6e73-4cd5-b332-920a7aaa8d9d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-aa978963-6e73-4cd5-b332-920a7aaa8d9d" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ba92b-d177-43e1-b5b9-82a763c0dcd6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:31 devstack sudo[109910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d
Jun 17 04:20:31 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d" returned: 0 in 0.764s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:31 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:32 devstack sudo[109918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d
Jun 17 04:20:32 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:32 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-aa978963-6e73-4cd5-b332-920a7aaa8d9d" returned: 0 in 0.641s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-aa978963-6e73-4cd5-b332-920a7aaa8d9d" released by "delete_volume" :: held 1.465s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=111,cinder:INSERT=36,cinder:UPDATE=125,cinder:DELETE=15 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Created reservations ['aad320fd-c15d-4cc5-a184-d88936133bfc', '4d782aed-8218-4ef3-9074-e5c6a749d046', 'd2f4b615-8ef6-4f12-95b4-b0633b963054', '214ce51a-cfc9-4692-881d-11e58bafc045'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:32 devstack sudo[109923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:32 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-27a5bad7-8593-4811-bd23-a988e9907844-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-27a5bad7-8593-4811-bd23-a988e9907844-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:33 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-quobyte-27a5bad7-8593-4811-bd23-a988e9907844" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.610s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Deleted volume successfully.
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-27a5bad7-8593-4811-bd23-a988e9907844" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-560e3678-085b-4f15-a966-a87f7554256e tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-aa978963-6e73-4cd5-b332-920a7aaa8d9d-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1001d31-2647-4039-b807-af3960274a1f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:33 devstack sudo[109932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844
Jun 17 04:20:33 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:34 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844" returned: 0 in 0.680s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:34 devstack sudo[109937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844
Jun 17 04:20:34 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:34 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-27a5bad7-8593-4811-bd23-a988e9907844" returned: 0 in 0.587s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-27a5bad7-8593-4811-bd23-a988e9907844" released by "delete_volume" :: held 1.313s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Created reservations ['3fe38e82-def0-4c42-b5ca-7fe9da27fa6b', '0937dc95-5c0e-4ba1-a650-c8485a188774', '801ee905-bce3-4d98-ab24-e5fedee963fd', '475b453c-9ce4-4259-8bfa-e8ece7bc189e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:34 devstack sudo[109940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:34 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:35 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.605s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Deleted volume successfully.
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f3b0764d-0c38-4189-8d62-98e81f1eb9ed tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-27a5bad7-8593-4811-bd23-a988e9907844-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-67994214-b4f9-4a07-a7ff-3ec61df7d3f6-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-67994214-b4f9-4a07-a7ff-3ec61df7d3f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-quobyte-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c61df-266c-4dc8-a2c3-c9ad51dcb8af]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:35 devstack sudo[109943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6
Jun 17 04:20:35 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:36 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" returned: 0 in 0.716s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:36 devstack sudo[109949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6
Jun 17 04:20:36 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:36 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" returned: 0 in 0.609s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-67994214-b4f9-4a07-a7ff-3ec61df7d3f6" released by "delete_volume" :: held 1.360s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Created reservations ['78331236-3564-40c4-a7e9-6c62e2784d29', '4dbbc9da-e392-4f1e-bd40-9a3707fd5f72', 'c7f535b5-1d1c-4823-9071-4e2b7a822654', 'e4ad0223-9e55-4301-aff5-3521977c4471'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:37 devstack sudo[109952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:37 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:37 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Deleted volume successfully.
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-3ca27990-9b87-4747-9880-7f9c217f9865 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-67994214-b4f9-4a07-a7ff-3ec61df7d3f6-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-03887bc1-aaec-4bba-8d83-f00b39046efb-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-03887bc1-aaec-4bba-8d83-f00b39046efb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-quobyte-03887bc1-aaec-4bba-8d83-f00b39046efb" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-03887bc1-aaec-4bba-8d83-f00b39046efb" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b38dd1-99d0-4dd3-8e1d-3bfbac587344]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:37 devstack sudo[109955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb
Jun 17 04:20:37 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:38 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb" returned: 0 in 0.743s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:38 devstack sudo[109963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb
Jun 17 04:20:38 devstack sudo[109963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:39 devstack sudo[109963]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-03887bc1-aaec-4bba-8d83-f00b39046efb" returned: 0 in 0.599s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-03887bc1-aaec-4bba-8d83-f00b39046efb" released by "delete_volume" :: held 1.388s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Created reservations ['767073ef-c684-4992-8b72-e083ecd34ccb', 'fc4f4e9d-1dcf-4937-8119-eb49a34d0c5e', 'eb7aa70d-018a-4b8e-8ef9-6a4b253c1f47', '9a178329-1db3-4e60-a173-3d985f6c08fc'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:39 devstack sudo[109966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:39 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:39 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.621s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:39 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Deleted volume successfully.
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f385e535-300d-47b9-8fa2-498c6c6d5852 tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-03887bc1-aaec-4bba-8d83-f00b39046efb-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-34dcc9af-a4e4-4cd9-8c88-6be468a763fc-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-34dcc9af-a4e4-4cd9-8c88-6be468a763fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "cinder-quobyte-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3f11ff-41b9-4199-a9e5-b44864012ebc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:40 devstack sudo[109969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc
Jun 17 04:20:40 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:40 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" returned: 0 in 0.739s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:40 devstack sudo[109974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc
Jun 17 04:20:40 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:41 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" returned: 0 in 0.635s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-quobyte-34dcc9af-a4e4-4cd9-8c88-6be468a763fc" released by "delete_volume" :: held 1.418s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Created reservations ['c5c339ac-b7c5-4ed0-ab03-43f78dd20072', 'eda39b28-478e-4bba-b5b1-a18d674403e1', 'eb0f831b-3751-4a7d-a4ff-5a51f54957f1', 'f6e2bf8b-9d84-4bb4-bfd0-0891ffb693ed'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Acquiring lock "cinder-1301feaf-9a79-44dd-a831-0368c881a5b9-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "cinder-1301feaf-9a79-44dd-a831-0368c881a5b9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:41 devstack sudo[109977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:41 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Acquiring lock "cinder-quobyte-1301feaf-9a79-44dd-a831-0368c881a5b9" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "cinder-quobyte-1301feaf-9a79-44dd-a831-0368c881a5b9" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[80489e12-77f4-4c85-803f-e228334c131d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:41 devstack sudo[109979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9
Jun 17 04:20:41 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:42 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Deleted volume successfully.
Jun 17 04:20:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-69abc055-0d14-4ecb-a16e-a2b4a412883d tempest-CreateVolumesFromImageTest-1189584817 None] Lock "cinder-34dcc9af-a4e4-4cd9-8c88-6be468a763fc-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:42 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9" returned: 0 in 0.738s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:42 devstack sudo[109985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9
Jun 17 04:20:42 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:43 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-1301feaf-9a79-44dd-a831-0368c881a5b9" returned: 0 in 0.626s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "cinder-quobyte-1301feaf-9a79-44dd-a831-0368c881a5b9" released by "delete_volume" :: held 1.405s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Created reservations ['c3a8126c-f4c8-474f-8afc-4667f822b6c9', 'f6495dcd-4796-43b6-a0f6-63dcc6e22ed5', 'c7aaf5f5-759f-4da9-8980-d25de6a510ad', 'c30b6f54-14b4-4fb5-a930-ed782d1c3a87'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:43 devstack sudo[109988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:20:43 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:43 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:20:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Deleted volume successfully.
Jun 17 04:20:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cfae696-d8eb-411c-82dd-1597da7401d6 tempest-VolumesNegativeTest-1267022022 None] Lock "cinder-1301feaf-9a79-44dd-a831-0368c881a5b9-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:20:53 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=81,cinder:INSERT=45,cinder:UPDATE=122,cinder:DELETE=10 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:20:53 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=45,cinder:SELECT=24,cinder:INSERT=10,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (1eb4f9fb-33f9-4e63-acc4-65e63b1e12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77288ba7-5160-454a-b005-5aed317e3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77288ba7-5160-454a-b005-5aed317e3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-716063087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af98bf7f-977d-44b7-a44e-e87bae5c9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:54Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44bd64d-7be4-48d7-99d3-0a41753e44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44bd64d-7be4-48d7-99d3-0a41753e44ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b84fb3e-3df8-4d6d-97ec-97ea7a38f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b84fb3e-3df8-4d6d-97ec-97ea7a38f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af98bf7f-977d-44b7-a44e-e87bae5c9c59', 'volume_name': 'volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eeacfa-994a-4eea-bb7d-a836ff8c9ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eeacfa-994a-4eea-bb7d-a836ff8c9ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566b6a0-ff7d-45d7-9fdb-3bf0c1adff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:54 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume af98bf7f-977d-44b7-a44e-e87bae5c9c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59', 'volume_size': 1}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-716063087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af98bf7f-977d-44b7-a44e-e87bae5c9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:20:54Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating volume af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:20:54 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:20:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:54 devstack sudo[110028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 1073741824
Jun 17 04:20:54 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:55 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 1073741824" returned: 0 in 0.745s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:55 devstack sudo[110035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59
Jun 17 04:20:55 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:55 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59" returned: 0 in 0.578s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566b6a0-ff7d-45d7-9fdb-3bf0c1adff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cf43b6-f452-4748-bc8c-e7b666b01ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:20:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 (af98bf7f-977d-44b7-a44e-e87bae5c9c59): created successfully
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cf43b6-f452-4748-bc8c-e7b666b01ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:20:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (1eb4f9fb-33f9-4e63-acc4-65e63b1e12d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:20:55 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4c96f658-2cf2-42f3-98e1-fc552077f1a0 tempest-VolumesSnapshotTestJSON-1564236796 None] Created volume successfully.
Jun 17 04:20:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:20:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:20:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating offline snapshot 93096e05-202b-446f-a29f-b3112318d30e of volume af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:20:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf1a8a9-cfa0-45bf-815c-3891c3f10919]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:20:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:56 devstack sudo[110039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59
Jun 17 04:20:56 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:57 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59" returned: 0 in 0.691s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:57 devstack sudo[110044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e 1G
Jun 17 04:20:57 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:58 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e 1G" returned: 0 in 0.737s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:58 devstack sudo[110051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e
Jun 17 04:20:58 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:58 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e" returned: 0 in 0.666s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:58 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e is being set with open permissions: ugo+rw
Jun 17 04:20:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:58 devstack sudo[110057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e
Jun 17 04:20:58 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:20:59 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root
Jun 17 04:20:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e" returned: 0 in 0.599s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:20:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:20:59 devstack sudo[110060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info
Jun 17 04:20:59 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:00 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info" returned: 0 in 0.578s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:00 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info is being set with open permissions: ugo+rw
Jun 17 04:21:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:00 devstack sudo[110063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info
Jun 17 04:21:00 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:00 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.info" returned: 0 in 0.607s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.969s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2e90c083-3ee5-4f6c-a419-227450b38206 tempest-VolumesSnapshotTestJSON-1564236796 None] Create snapshot completed successfully
Jun 17 04:21:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-93096e05-202b-446f-a29f-b3112318d30e-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-93096e05-202b-446f-a29f-b3112318d30e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" acquired by "delete_snapshot" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-93096e05-202b-446f-a29f-b3112318d30e" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-93096e05-202b-446f-a29f-b3112318d30e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleting offline snapshot 93096e05-202b-446f-a29f-b3112318d30e of volume af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] snapshot_file for this snap is: volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[48506713-e994-4e98-a8a8-474f1c80eac1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:01 devstack sudo[110066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e
Jun 17 04:21:01 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:01 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e" returned: 0 in 0.683s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56bebf-0175-4fb9-8b00-a7a7cbedb9f6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:01 devstack sudo[110071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59
Jun 17 04:21:01 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:02 devstack sudo[110073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:02 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:02 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:02 devstack sudo[110078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e
Jun 17 04:21:02 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:02 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.636s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:21:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:21:03 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:03 devstack sudo[110084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e
Jun 17 04:21:03 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:03 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59.93096e05-202b-446f-a29f-b3112318d30e" returned: 0 in 0.571s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-93096e05-202b-446f-a29f-b3112318d30e" released by "_delete_snapshot" :: held 2.746s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" released by "delete_snapshot" :: held 2.768s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['8c3d505e-c9fd-456e-9c88-19392d595975', 'ffabc7e8-70f9-428d-82c7-1ee469f277a7', 'c1682aed-e36d-4b6b-a79f-41d8d55d5898', 'ba091572-4273-4ec0-a470-63b8204fe23a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Delete snapshot completed successfully.
Jun 17 04:21:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbdf70d-d29f-4e41-99b5-2b0437faeac5 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-93096e05-202b-446f-a29f-b3112318d30e-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (09996ad9-a1c8-4e59-8850-cce16aaf8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e655922-989f-40b3-aa15-e8e19774ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e655922-989f-40b3-aa15-e8e19774ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131288473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c9e4c6-9020-40d1-a0c9-30869292fdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:05Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcfa8ec-7ca1-46f0-9d1f-23e15a7218cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcfa8ec-7ca1-46f0-9d1f-23e15a7218cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c5a1b7-d873-4a99-aaaf-20dcf830df08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c5a1b7-d873-4a99-aaaf-20dcf830df08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c9e4c6-9020-40d1-a0c9-30869292fdbd', 'volume_name': 'volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b11919-e971-444f-82b1-0a12ba3c56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b11919-e971-444f-82b1-0a12ba3c56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f843777-f2fb-490c-88c7-52f5f66b2730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Volume b2c9e4c6-9020-40d1-a0c9-30869292fdbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd', 'volume_size': 1}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131288473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c9e4c6-9020-40d1-a0c9-30869292fdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:05Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Creating volume b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:21:04 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:21:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:04 devstack sudo[110087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd 1073741824
Jun 17 04:21:04 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:05 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd 1073741824" returned: 0 in 0.749s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:05 devstack sudo[110092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:05 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:06 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.583s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f843777-f2fb-490c-88c7-52f5f66b2730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8add9e0-0bce-4261-85cf-4ddac2a9d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:06 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Volume volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd (b2c9e4c6-9020-40d1-a0c9-30869292fdbd): created successfully
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8add9e0-0bce-4261-85cf-4ddac2a9d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (09996ad9-a1c8-4e59-8850-cce16aaf8378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-836cd746-229e-462b-9560-3104203c1b2d tempest-VolumesSnapshotTestJSON-1564236796 None] Created volume successfully.
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Creating offline snapshot a652c233-d176-447d-b2ad-cf21bd0e6acb of volume b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf57733-be6d-4b2c-ac19-40d30b94346c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:06 devstack sudo[110096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:06 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:07 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:07 devstack sudo[110101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb 1G
Jun 17 04:21:07 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:08 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb 1G" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:08 devstack sudo[110106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:08 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:08 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.611s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:08 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb is being set with open permissions: ugo+rw
Jun 17 04:21:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:08 devstack sudo[110112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:08 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:09 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.558s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:09 devstack sudo[110115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info
Jun 17 04:21:09 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:10 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info" returned: 0 in 0.579s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:10 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info is being set with open permissions: ugo+rw
Jun 17 04:21:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:10 devstack sudo[110118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info
Jun 17 04:21:10 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:10 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.info" returned: 0 in 0.566s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.864s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b977ebbe-994a-4149-b16b-1f048f19597f tempest-VolumesSnapshotTestJSON-1564236796 None] Create snapshot completed successfully
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (e6d1575c-619a-4e38-aa04-5889e70ecfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a114316-6aee-41de-b953-898d9bbe4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a114316-6aee-41de-b953-898d9bbe4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1002278676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63483816-0ca4-4bfd-9a83-81b8021d541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a652c233-d176-447d-b2ad-cf21bd0e6acb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:11Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb8931-fa3c-4291-bad3-8b9ae3d65cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb8931-fa3c-4291-bad3-8b9ae3d65cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d844f2-efdf-439b-a29f-76f4c653342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d844f2-efdf-439b-a29f-76f4c653342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63483816-0ca4-4bfd-9a83-81b8021d541d', 'volume_name': 'volume-63483816-0ca4-4bfd-9a83-81b8021d541d', 'volume_size': 2, 'snapshot_id': 'a652c233-d176-447d-b2ad-cf21bd0e6acb'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee073a8-6d89-46af-9104-2ca0d7204039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee073a8-6d89-46af-9104-2ca0d7204039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b20a42-5279-4053-9ff8-cf4feef05fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:11 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume 63483816-0ca4-4bfd-9a83-81b8021d541d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63483816-0ca4-4bfd-9a83-81b8021d541d', 'volume_size': 2, 'snapshot_id': 'a652c233-d176-447d-b2ad-cf21bd0e6acb'}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb-63483816-0ca4-4bfd-9a83-81b8021d541d" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb-63483816-0ca4-4bfd-9a83-81b8021d541d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating volume 63483816-0ca4-4bfd-9a83-81b8021d541d from snapshot a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] snapshot: a652c233-d176-447d-b2ad-cf21bd0e6acb, volume: 63483816-0ca4-4bfd-9a83-81b8021d541d,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5221b5-25d7-42b0-a42c-feac9e61e75b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:11 devstack sudo[110121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:11 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:12 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.679s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[677c8116-3c56-40ac-93ed-c43e07d064cc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:12 devstack sudo[110126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:12 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:12 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:21:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:12 devstack sudo[110131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d
Jun 17 04:21:12 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:17 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d" returned: 0 in 4.332s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:17 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2117c8-fe07-4718-a215-323eaa096c4c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:17 devstack sudo[110145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:17 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:18 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.857s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:21:18 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Converted 1024.00 MB image at 236.32 MB/s
Jun 17 04:21:18 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d is being set with open permissions: ugo+rw
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:18 devstack sudo[110150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d
Jun 17 04:21:18 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:18 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d" returned: 0 in 0.562s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" released by "_copy_volume_from_snapshot" :: held 7.181s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb-63483816-0ca4-4bfd-9a83-81b8021d541d" released by "_create_volume_from_snapshot" :: held 7.211s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.226s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b20a42-5279-4053-9ff8-cf4feef05fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63483816-0ca4-4bfd-9a83-81b8021d541d', 'volume_size': 2, 'snapshot_id': 'a652c233-d176-447d-b2ad-cf21bd0e6acb'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075795fe-1978-4194-9c0e-f3ac296dc5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume volume-63483816-0ca4-4bfd-9a83-81b8021d541d (63483816-0ca4-4bfd-9a83-81b8021d541d): created successfully
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075795fe-1978-4194-9c0e-f3ac296dc5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (e6d1575c-619a-4e38-aa04-5889e70ecfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:18 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fa6980e7-86fe-4af6-a87c-9fffaa886621 tempest-VolumesSnapshotTestJSON-1564236796 None] Created volume successfully.
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-63483816-0ca4-4bfd-9a83-81b8021d541d-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-63483816-0ca4-4bfd-9a83-81b8021d541d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0733104-c853-48d8-bc35-b6e37fdf2c3e]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:19 devstack sudo[110153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d
Jun 17 04:21:19 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:19 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:19 devstack sudo[110158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d
Jun 17 04:21:19 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:20 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-63483816-0ca4-4bfd-9a83-81b8021d541d" returned: 0 in 0.601s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-63483816-0ca4-4bfd-9a83-81b8021d541d" released by "delete_volume" :: held 1.323s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['f989d93e-a41f-44f9-a6e7-24a5609c1040', '9230ccf8-e2e7-4d9b-a814-1fb809a5b43e', '15987db8-24ab-4b66-9131-4df5f1c537e0', '202514e6-2134-4b95-a9d3-e4cf8f84465d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:20 devstack sudo[110161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:20 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:21 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.578s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:21 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleted volume successfully.
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86d00316-a494-4d85-9219-8459d81a32d2 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-63483816-0ca4-4bfd-9a83-81b8021d541d-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-a652c233-d176-447d-b2ad-cf21bd0e6acb-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-a652c233-d176-447d-b2ad-cf21bd0e6acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleting offline snapshot a652c233-d176-447d-b2ad-cf21bd0e6acb of volume b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] snapshot_file for this snap is: volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ea466-05c6-4fe5-81d0-31b2f95e8712]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:21 devstack sudo[110164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:21 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:22 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7dfab7-8d65-4e55-a59e-d4ed017f5138]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:22 devstack sudo[110170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:22 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:22 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:22 devstack sudo[110175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:22 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:23 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.662s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:23 devstack sudo[110180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb
Jun 17 04:21:23 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:24 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd.a652c233-d176-447d-b2ad-cf21bd0e6acb" returned: 0 in 0.583s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-a652c233-d176-447d-b2ad-cf21bd0e6acb" released by "_delete_snapshot" :: held 2.717s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" released by "delete_snapshot" :: held 2.737s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['017c398b-8710-4692-a1d7-9ac9a900bde1', '2fcb9c75-fe22-4805-b25e-27672290cf01', '30076933-0429-493a-b46c-101fc4b8e6d2', 'afffe288-ad7f-46b7-a748-36ea8c5bb0bb'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Delete snapshot completed successfully.
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-918c0ef2-3be3-4e10-bcca-82dfecf3f505 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-a652c233-d176-447d-b2ad-cf21bd0e6acb-delete_snapshot" released by "delete_snapshot" :: held 2.852s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-b2c9e4c6-9020-40d1-a0c9-30869292fdbd-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-b2c9e4c6-9020-40d1-a0c9-30869292fdbd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457a90d-f242-47c2-bdee-3258814a14b4]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:24 devstack sudo[110183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:24 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:25 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:25 devstack sudo[110188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd
Jun 17 04:21:25 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:25 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" returned: 0 in 0.582s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b2c9e4c6-9020-40d1-a0c9-30869292fdbd" released by "delete_volume" :: held 1.312s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:25 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['7972feff-616a-4713-959d-13c582b41a5f', '78d8ff02-6809-4374-aa34-18a48eb8a39d', '3c59ab58-efa2-4aee-ac67-bcffff37e0a5', '6993a43b-df7f-49c1-8495-8a1f4facd564'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:26 devstack sudo[110192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:26 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:26 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.571s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:26 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleted volume successfully.
Jun 17 04:21:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1f365771-2b66-4274-97e9-c9dd74c9d950 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-b2c9e4c6-9020-40d1-a0c9-30869292fdbd-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (273746af-9b0f-4d49-948a-ab4fa58878e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f248413-e958-4338-8628-48f7627c4aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f248413-e958-4338-8628-48f7627c4aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1180985573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b136538-60bb-4813-9801-1fc590d8a0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:27Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d322568-75d5-4c37-9a55-1b8f80877923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d322568-75d5-4c37-9a55-1b8f80877923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1eb78f-4740-4c1b-9e91-faa53a8adc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1eb78f-4740-4c1b-9e91-faa53a8adc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b136538-60bb-4813-9801-1fc590d8a0ea', 'volume_name': 'volume-6b136538-60bb-4813-9801-1fc590d8a0ea', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb7a9c7-0068-4a83-9333-086281804381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb7a9c7-0068-4a83-9333-086281804381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e0e88c-a129-472f-816f-24dbd649c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:27 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume 6b136538-60bb-4813-9801-1fc590d8a0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b136538-60bb-4813-9801-1fc590d8a0ea', 'volume_size': 1}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1180985573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b136538-60bb-4813-9801-1fc590d8a0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:27Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating volume 6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:21:27 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:21:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:27 devstack sudo[110195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea 1073741824
Jun 17 04:21:27 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:28 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea 1073741824" returned: 0 in 0.744s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:28 devstack sudo[110201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:28 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:28 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e0e88c-a129-472f-816f-24dbd649c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b136538-60bb-4813-9801-1fc590d8a0ea', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98f32db-ab5e-4279-8d67-302f0c8ac70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume volume-6b136538-60bb-4813-9801-1fc590d8a0ea (6b136538-60bb-4813-9801-1fc590d8a0ea): created successfully
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98f32db-ab5e-4279-8d67-302f0c8ac70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (273746af-9b0f-4d49-948a-ab4fa58878e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c25cabc3-6dac-4600-bc87-dcc51abbe262 tempest-VolumesSnapshotTestJSON-1564236796 None] Created volume successfully.
Jun 17 04:21:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating offline snapshot b6c3465d-a917-4614-a48a-dd387b3a911b of volume 6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:21:29 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[59292f94-190e-4f53-b3dd-8c5666fc3cde]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:29 devstack sudo[110204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:29 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:30 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:30 devstack sudo[110209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b 1G
Jun 17 04:21:30 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:30 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b 1G" returned: 0 in 0.759s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b136538-60bb-4813-9801-1fc590d8a0ea -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:30 devstack sudo[110215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b136538-60bb-4813-9801-1fc590d8a0ea -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:30 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:31 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b136538-60bb-4813-9801-1fc590d8a0ea -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:31 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b is being set with open permissions: ugo+rw
Jun 17 04:21:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:31 devstack sudo[110221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:31 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:32 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.591s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:32 devstack sudo[110224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info
Jun 17 04:21:32 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:32 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info" returned: 0 in 0.580s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:32 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info is being set with open permissions: ugo+rw
Jun 17 04:21:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:32 devstack sudo[110228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info
Jun 17 04:21:32 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:33 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.info" returned: 0 in 0.596s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.931s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-87d738b0-6889-4615-a0fa-0ed3e9c5d4d7 tempest-VolumesSnapshotTestJSON-1564236796 None] Create snapshot completed successfully
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (f226a412-8407-4c86-90f6-a7b3e138ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b18367-6fc8-4909-bc02-3487f661c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b18367-6fc8-4909-bc02-3487f661c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522941133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef28cbc-35e2-4c97-9341-f47f0e28c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f0180029e54b9d933a339b8b838a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6c3465d-a917-4614-a48a-dd387b3a911b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:34Z,use_quota=True,user_id='6d01e65e735c4af2ae7878a37c211a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d56683-f9ce-48be-ad35-899503265c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d56683-f9ce-48be-ad35-899503265c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda0181-9c4b-486d-b6ad-d81f5424d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda0181-9c4b-486d-b6ad-d81f5424d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bef28cbc-35e2-4c97-9341-f47f0e28c828', 'volume_name': 'volume-bef28cbc-35e2-4c97-9341-f47f0e28c828', 'volume_size': 1, 'snapshot_id': 'b6c3465d-a917-4614-a48a-dd387b3a911b'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d16712c-a690-43da-aac3-9ada98b64167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d16712c-a690-43da-aac3-9ada98b64167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e16ed6-682b-4187-802c-c2448241a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:34 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume bef28cbc-35e2-4c97-9341-f47f0e28c828: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bef28cbc-35e2-4c97-9341-f47f0e28c828', 'volume_size': 1, 'snapshot_id': 'b6c3465d-a917-4614-a48a-dd387b3a911b'}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b-bef28cbc-35e2-4c97-9341-f47f0e28c828" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b-bef28cbc-35e2-4c97-9341-f47f0e28c828" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating volume bef28cbc-35e2-4c97-9341-f47f0e28c828 from snapshot b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] snapshot: b6c3465d-a917-4614-a48a-dd387b3a911b, volume: bef28cbc-35e2-4c97-9341-f47f0e28c828,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb149b1e-19eb-4f24-aa89-ff79e2a8f7af]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:34 devstack sudo[110237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:34 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:34 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b136538-60bb-4813-9801-1fc590d8a0ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[203ec076-1c3d-48a9-bc68-37bf91619782]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:35 devstack sudo[110242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:35 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:35 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:35 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:21:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:35 devstack sudo[110247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828
Jun 17 04:21:35 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:39 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828" returned: 0 in 4.194s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:39 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832cae2-9991-465d-a72b-8d1387ce00d6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:39 devstack sudo[110261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:39 devstack sudo[110261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:40 devstack sudo[110261]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.836s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:40 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:21:40 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Converted 1024.00 MB image at 244.03 MB/s
Jun 17 04:21:40 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 is being set with open permissions: ugo+rw
Jun 17 04:21:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:40 devstack sudo[110266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828
Jun 17 04:21:40 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:41 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828" returned: 0 in 0.563s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" released by "_copy_volume_from_snapshot" :: held 7.074s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b-bef28cbc-35e2-4c97-9341-f47f0e28c828" released by "_create_volume_from_snapshot" :: held 7.103s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.118s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e16ed6-682b-4187-802c-c2448241a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef28cbc-35e2-4c97-9341-f47f0e28c828', 'volume_size': 1, 'snapshot_id': 'b6c3465d-a917-4614-a48a-dd387b3a911b'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b643eaf-eca1-415f-8370-473447de5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:41 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Volume volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 (bef28cbc-35e2-4c97-9341-f47f0e28c828): created successfully
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b643eaf-eca1-415f-8370-473447de5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Flow 'volume_create_manager' (f226a412-8407-4c86-90f6-a7b3e138ef14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1a4f45c9-6072-4f58-a7db-33677786e194 tempest-VolumesSnapshotTestJSON-1564236796 None] Created volume successfully.
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-bef28cbc-35e2-4c97-9341-f47f0e28c828-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-bef28cbc-35e2-4c97-9341-f47f0e28c828-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a0275-0c69-457a-a51f-1edc3d440b08]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:41 devstack sudo[110269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828
Jun 17 04:21:41 devstack sudo[110269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:42 devstack sudo[110269]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828" returned: 0 in 0.678s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:42 devstack sudo[110274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828
Jun 17 04:21:42 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:43 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bef28cbc-35e2-4c97-9341-f47f0e28c828" returned: 0 in 0.576s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-bef28cbc-35e2-4c97-9341-f47f0e28c828" released by "delete_volume" :: held 1.292s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['bbdbf509-c74f-4a9d-899c-73c1760df7a5', 'eb0d91a9-1638-4ac5-8baa-55c9a62ae79e', 'e9bdb248-52c2-4d62-b37b-b5b2fdf6a9a2', '26bfbea1-8300-407f-abe0-5f54eedd492f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:43 devstack sudo[110277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:43 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:43 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.564s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:43 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Deleted volume successfully.
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1361bbe8-4102-44d8-99c2-71f595175dfc tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-bef28cbc-35e2-4c97-9341-f47f0e28c828-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-b6c3465d-a917-4614-a48a-dd387b3a911b-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-b6c3465d-a917-4614-a48a-dd387b3a911b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleting offline snapshot b6c3465d-a917-4614-a48a-dd387b3a911b of volume 6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] snapshot_file for this snap is: volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b593b54a-07ab-4479-b5c7-129ca4733948]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:44 devstack sudo[110280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:44 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:44 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.665s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b136538-60bb-4813-9801-1fc590d8a0ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b791f-d1f4-4342-b464-a3b85029c6a2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:44 devstack sudo[110285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:44 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:45 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.665s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:45 devstack sudo[110290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:45 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:46 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.648s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:46 devstack sudo[110297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b
Jun 17 04:21:46 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:46 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea.b6c3465d-a917-4614-a48a-dd387b3a911b" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-b6c3465d-a917-4614-a48a-dd387b3a911b" released by "_delete_snapshot" :: held 2.648s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" released by "delete_snapshot" :: held 2.669s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['f02e0230-dc96-4225-9f46-1e9c68f3f1f8', '4a956472-d35c-4b74-9026-4b31ec2e0a00', '526f1871-6a5d-46ab-b20b-50d8df75abbe', 'f1d780a8-c5e9-4680-923b-d1ec694ecba4'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Delete snapshot completed successfully.
Jun 17 04:21:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fc208b7d-8dc6-4bd4-afdc-aa1a6c8910e6 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-b6c3465d-a917-4614-a48a-dd387b3a911b-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-6b136538-60bb-4813-9801-1fc590d8a0ea-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-6b136538-60bb-4813-9801-1fc590d8a0ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d779db-fa8a-443d-a7fb-2190a46a05a5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:47 devstack sudo[110300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:47 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:47 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:48 devstack sudo[110305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea
Jun 17 04:21:48 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:48 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6b136538-60bb-4813-9801-1fc590d8a0ea" returned: 0 in 0.558s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-6b136538-60bb-4813-9801-1fc590d8a0ea" released by "delete_volume" :: held 1.287s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['867997f6-40b6-45f3-b99b-4e4f6b334781', '526ef417-9ae9-4a15-a615-6ae76272e793', 'ef186eb1-e64e-4c3c-b426-84273777e0ea', '578113f8-fcbf-478e-8ec1-1cef2bc9c18f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:48 devstack sudo[110308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:48 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:49 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.583s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleted volume successfully.
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-0cbe2a26-4c96-4e41-9a80-7b3f872ee571 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-6b136538-60bb-4813-9801-1fc590d8a0ea-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-af98bf7f-977d-44b7-a44e-e87bae5c9c59-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-af98bf7f-977d-44b7-a44e-e87bae5c9c59-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" acquired by "delete_volume" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6ee09-a085-49af-bf20-08e4021a2d26]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:49 devstack sudo[110311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59
Jun 17 04:21:49 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:50 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:50 devstack sudo[110316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59
Jun 17 04:21:50 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:50 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-af98bf7f-977d-44b7-a44e-e87bae5c9c59" returned: 0 in 0.574s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-quobyte-af98bf7f-977d-44b7-a44e-e87bae5c9c59" released by "delete_volume" :: held 1.304s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Created reservations ['4c34a114-ea6d-4816-b635-6c9f2620d358', '036ad2cd-9dda-4df9-a39a-cc26b0700375', '63fb6c0c-c87c-405e-9cbf-225116f7b0f8', 'f6fd9168-2cd0-466a-a26c-696ca97564f2'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:50 devstack sudo[110319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:21:50 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:51 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.560s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:51 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:21:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Deleted volume successfully.
Jun 17 04:21:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa722095-f632-4cbb-a064-e3400f293af0 tempest-VolumesSnapshotTestJSON-1564236796 None] Lock "cinder-af98bf7f-977d-44b7-a44e-e87bae5c9c59-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=67,cinder:UPDATE=84,cinder:INSERT=15,cinder:DELETE=5 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=67,cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=23 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Flow 'volume_create_manager' (40ee4fff-a58e-49c8-9f0d-622361129599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd62397-a15f-48f2-a3d3-84da89cfaaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd62397-a15f-48f2-a3d3-84da89cfaaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-936215281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669035e8-2e89-45a5-b99a-97555c81cfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5adbd824814956a204bfcc707fd788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:57Z,use_quota=True,user_id='2d38a6ca65e54108aafd2f11940a19a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeaf1c5-36c5-4ce0-b374-d31e5bbe9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeaf1c5-36c5-4ce0-b374-d31e5bbe9f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169e83b2-6d41-4610-a056-065b7d3cc6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169e83b2-6d41-4610-a056-065b7d3cc6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669035e8-2e89-45a5-b99a-97555c81cfcb', 'volume_name': 'volume-669035e8-2e89-45a5-b99a-97555c81cfcb', 'volume_size': 2}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bd9046-99f0-49d3-82fa-5db792c4376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bd9046-99f0-49d3-82fa-5db792c4376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f370d0d4-463e-4331-8012-4d2a5a53445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:57 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Volume 669035e8-2e89-45a5-b99a-97555c81cfcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669035e8-2e89-45a5-b99a-97555c81cfcb', 'volume_size': 2}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-936215281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669035e8-2e89-45a5-b99a-97555c81cfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5adbd824814956a204bfcc707fd788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:21:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:21:57Z,use_quota=True,user_id='2d38a6ca65e54108aafd2f11940a19a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Creating volume 669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:21:57 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:21:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb 2147483648 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:57 devstack sudo[110363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb 2147483648
Jun 17 04:21:57 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:58 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb 2147483648" returned: 0 in 0.783s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:58 devstack sudo[110371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb
Jun 17 04:21:58 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:21:58 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb" returned: 0 in 0.588s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f370d0d4-463e-4331-8012-4d2a5a53445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669035e8-2e89-45a5-b99a-97555c81cfcb', 'volume_size': 2}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e88e1-2552-43a7-b2c8-1958d4f2d8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:21:58 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Volume volume-669035e8-2e89-45a5-b99a-97555c81cfcb (669035e8-2e89-45a5-b99a-97555c81cfcb): created successfully
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e88e1-2552-43a7-b2c8-1958d4f2d8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:21:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Flow 'volume_create_manager' (40ee4fff-a58e-49c8-9f0d-622361129599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:21:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f53466e2-4747-421c-b224-03a4a7434de3 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Created volume successfully.
Jun 17 04:21:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:21:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:21:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Creating offline snapshot 672b1f70-00fe-4f91-8e41-9ff45b18de18 of volume 669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:21:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b73b8-7711-4a59-9ae0-b38f99a99ef3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:21:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:21:59 devstack sudo[110374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb
Jun 17 04:21:59 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:00 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 2G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:00 devstack sudo[110379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 2G
Jun 17 04:22:00 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:00 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 2G" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669035e8-2e89-45a5-b99a-97555c81cfcb -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:00 devstack sudo[110384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669035e8-2e89-45a5-b99a-97555c81cfcb -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18
Jun 17 04:22:00 devstack sudo[110384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:01 devstack sudo[110384]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669035e8-2e89-45a5-b99a-97555c81cfcb -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18" returned: 0 in 0.638s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:01 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 is being set with open permissions: ugo+rw
Jun 17 04:22:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:01 devstack sudo[110389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18
Jun 17 04:22:01 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:02 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18" returned: 0 in 0.565s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:02 devstack sudo[110392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info
Jun 17 04:22:02 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:02 devstack sudo[110393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:02 devstack sudo[110393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:02 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info" returned: 0 in 0.591s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:02 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info is being set with open permissions: ugo+rw
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:02 devstack sudo[110393]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.584s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:22:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:22:02 devstack sudo[110398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info
Jun 17 04:22:02 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:03 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.info" returned: 0 in 0.557s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6acaf138-68c3-4a0c-baad-a2f02ff82349 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Create snapshot completed successfully
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "cinder-672b1f70-00fe-4f91-8e41-9ff45b18de18-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-672b1f70-00fe-4f91-8e41-9ff45b18de18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "cinder-quobyte-672b1f70-00fe-4f91-8e41-9ff45b18de18" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-672b1f70-00fe-4f91-8e41-9ff45b18de18" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Deleting offline snapshot 672b1f70-00fe-4f91-8e41-9ff45b18de18 of volume 669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] snapshot_file for this snap is: volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945fba2-c481-4f23-aebd-a930ee8cd4fc]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:04 devstack sudo[110401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18
Jun 17 04:22:04 devstack sudo[110401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:04 devstack sudo[110401]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18" returned: 0 in 0.707s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669035e8-2e89-45a5-b99a-97555c81cfcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bee9f70-d478-472f-9155-bdcf948369a7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:04 devstack sudo[110406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb
Jun 17 04:22:04 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:05 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:05 devstack sudo[110411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18
Jun 17 04:22:05 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:06 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18" returned: 0 in 0.659s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:06 devstack sudo[110417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18
Jun 17 04:22:06 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:06 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb.672b1f70-00fe-4f91-8e41-9ff45b18de18" returned: 0 in 0.584s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-672b1f70-00fe-4f91-8e41-9ff45b18de18" released by "_delete_snapshot" :: held 2.730s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" released by "delete_snapshot" :: held 2.752s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Created reservations ['50e645c9-cab6-4cf6-a130-6fe253f4e572', 'b994881e-f62f-4e92-95bb-f175015eb2ad', 'fcdd1a3d-d400-4e57-b30a-5b356919bec5', '3fd01e66-ad29-4492-b022-4398fa8296c6'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:06 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Delete snapshot completed successfully.
Jun 17 04:22:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-10f5b2f6-c74d-46e1-8c8d-930b43ba50a0 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-672b1f70-00fe-4f91-8e41-9ff45b18de18-delete_snapshot" released by "delete_snapshot" :: held 2.887s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "cinder-669035e8-2e89-45a5-b99a-97555c81cfcb-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-669035e8-2e89-45a5-b99a-97555c81cfcb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec62153d-d148-492d-a1ae-13720edbaba0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:07 devstack sudo[110420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb
Jun 17 04:22:07 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:08 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb" returned: 0 in 0.702s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:08 devstack sudo[110425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb
Jun 17 04:22:08 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:08 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-669035e8-2e89-45a5-b99a-97555c81cfcb" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-quobyte-669035e8-2e89-45a5-b99a-97555c81cfcb" released by "delete_volume" :: held 1.329s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Created reservations ['fcbdb6c0-901e-4d17-a421-6c043d7f0206', 'c8dd593a-c227-4bc2-a227-69df8dda6175', 'a447e85f-e405-4d6c-8a98-8331525b2ae4', '9291a2e7-ed83-4177-a7d6-ef54db9b0ab9'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:08 devstack sudo[110428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:08 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:09 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:09 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:09 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Deleted volume successfully.
Jun 17 04:22:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b4812511-b19c-42b3-bf98-e3494cd93f01 tempest-VolumesSnapshotNegativeTestJSON-584683569 None] Lock "cinder-669035e8-2e89-45a5-b99a-97555c81cfcb-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (1dade0f8-8c79-47e0-80c1-f1e7fc94b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704e1e04-a28b-4eb1-b957-468ee856e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704e1e04-a28b-4eb1-b957-468ee856e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164892733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efa8f12-d277-45df-96df-f6c7e9a51a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:12Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d14a69-5526-4125-be70-36ef80df52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d14a69-5526-4125-be70-36ef80df52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c78c101-382a-4536-a1f1-a3891803b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c78c101-382a-4536-a1f1-a3891803b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6efa8f12-d277-45df-96df-f6c7e9a51a19', 'volume_name': 'volume-6efa8f12-d277-45df-96df-f6c7e9a51a19', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17054872-8128-4b49-bb0d-905c30ef6ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17054872-8128-4b49-bb0d-905c30ef6ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159518e0-9eea-4bf1-a2b7-dfdf44546635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:11 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume 6efa8f12-d277-45df-96df-f6c7e9a51a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6efa8f12-d277-45df-96df-f6c7e9a51a19', 'volume_size': 1}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164892733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efa8f12-d277-45df-96df-f6c7e9a51a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:12Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume 6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:11 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:11 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:12 devstack sudo[110431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 1073741824
Jun 17 04:22:12 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:12 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 1073741824" returned: 0 in 0.759s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:12 devstack sudo[110437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19
Jun 17 04:22:12 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:13 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159518e0-9eea-4bf1-a2b7-dfdf44546635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efa8f12-d277-45df-96df-f6c7e9a51a19', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfeeeb16-449a-4257-8a62-4ba95a00f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:13 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 (6efa8f12-d277-45df-96df-f6c7e9a51a19): created successfully
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfeeeb16-449a-4257-8a62-4ba95a00f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:13 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (1dade0f8-8c79-47e0-80c1-f1e7fc94b997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:13 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b49899a3-65b9-4fa1-a811-b8030ab6251a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating offline snapshot 4d191b8c-5c26-4bb9-9c8e-734b9804afa1 of volume 6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add0a15-ee26-4ed2-a0a0-3f5963f600d6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:14 devstack sudo[110440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19
Jun 17 04:22:14 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:14 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19" returned: 0 in 0.690s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:14 devstack sudo[110445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 1G
Jun 17 04:22:14 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:15 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 1G" returned: 0 in 0.708s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:15 devstack sudo[110450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1
Jun 17 04:22:15 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:16 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:16 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 is being set with open permissions: ugo+rw
Jun 17 04:22:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:16 devstack sudo[110456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1
Jun 17 04:22:16 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:16 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1" returned: 0 in 0.574s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:16 devstack sudo[110459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info
Jun 17 04:22:16 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:17 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info" returned: 0 in 0.568s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:17 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info is being set with open permissions: ugo+rw
Jun 17 04:22:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:17 devstack sudo[110462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info
Jun 17 04:22:17 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:17 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.info" returned: 0 in 0.575s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.807s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:18 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e930a42f-ad93-4ca7-8d88-97813b0ca43f tempest-CreateVolumesFromSnapshotTest-1613173044 None] Create snapshot completed successfully
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (6b2d45e7-4bbe-4d12-943a-b4e027c79074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e23f6c2-d3cb-4bc0-89c7-efe90bc3145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e23f6c2-d3cb-4bc0-89c7-efe90bc3145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-464277500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f09c8cd-0459-4de0-bb3a-4794dbbc2e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a48b5d-4f13-4d66-9fdb-6fd5b73861c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a48b5d-4f13-4d66-9fdb-6fd5b73861c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35304e1b-28e2-488e-bd1b-f32f02e56184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35304e1b-28e2-488e-bd1b-f32f02e56184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f09c8cd-0459-4de0-bb3a-4794dbbc2e65', 'volume_name': 'volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5abde33-96ea-41a9-91e9-c458edf9b8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5abde33-96ea-41a9-91e9-c458edf9b8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64a023b-ff83-4b81-9fac-d5be01b7519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:18 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume 5f09c8cd-0459-4de0-bb3a-4794dbbc2e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65', 'volume_size': 1}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-464277500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f09c8cd-0459-4de0-bb3a-4794dbbc2e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume 5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:18 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:18 devstack sudo[110465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 1073741824
Jun 17 04:22:18 devstack sudo[110465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (1ecd3ec4-a42e-470f-99d9-2b311615561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa4ea72-161d-4dd2-ab8b-096875c936ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa4ea72-161d-4dd2-ab8b-096875c936ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-27729166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3c0a19-da01-4de8-bb16-93bce41fe759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7612acca-74c5-4c3c-b04e-76a722fc9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7612acca-74c5-4c3c-b04e-76a722fc9625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcd2f8a-ca59-41bf-8ab3-656f84ba426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcd2f8a-ca59-41bf-8ab3-656f84ba426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3c0a19-da01-4de8-bb16-93bce41fe759', 'volume_name': 'volume-ea3c0a19-da01-4de8-bb16-93bce41fe759', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5c2b0-5d25-4334-8420-e8f00c9d1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5c2b0-5d25-4334-8420-e8f00c9d1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286cd329-9212-467a-854c-b04f46524e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume ea3c0a19-da01-4de8-bb16-93bce41fe759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3c0a19-da01-4de8-bb16-93bce41fe759', 'volume_size': 1}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (4bf1d3dd-2d3c-4f65-8ae4-de349d3cac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60071182-0e2d-4cf4-b65e-171ed817ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60071182-0e2d-4cf4-b65e-171ed817ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457491094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43099347-675c-4edf-8662-0c1c4e4ae366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b88209-3ba4-4562-9e89-f823992aecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b88209-3ba4-4562-9e89-f823992aecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8eef97-580a-4782-a274-425e0f3b261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8eef97-580a-4782-a274-425e0f3b261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43099347-675c-4edf-8662-0c1c4e4ae366', 'volume_name': 'volume-43099347-675c-4edf-8662-0c1c4e4ae366', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcf121a-2a36-42fa-99b6-725613297317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcf121a-2a36-42fa-99b6-725613297317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721fd785-03fa-401f-b3ff-0e9b6143e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume 43099347-675c-4edf-8662-0c1c4e4ae366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43099347-675c-4edf-8662-0c1c4e4ae366', 'volume_size': 1}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:19 devstack sudo[110465]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 1073741824" returned: 0 in 0.840s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:19 devstack sudo[110470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65
Jun 17 04:22:19 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (8e9a4f34-c268-47d3-bb7d-de583549d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123a357e-d5db-4c39-9582-30124e4bcd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123a357e-d5db-4c39-9582-30124e4bcd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508736365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23194cba-841d-41ac-9ce9-40a62194e098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:20Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f822d79d-f7bb-4e2f-a7f1-f606834d7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f822d79d-f7bb-4e2f-a7f1-f606834d7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7471f40-8d40-4f93-ad61-baf46e28f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7471f40-8d40-4f93-ad61-baf46e28f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23194cba-841d-41ac-9ce9-40a62194e098', 'volume_name': 'volume-23194cba-841d-41ac-9ce9-40a62194e098', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e03a63-751e-442a-b094-3b975eab9309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e03a63-751e-442a-b094-3b975eab9309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f101601-206e-4878-8c37-85cc44fd3675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:19 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume 23194cba-841d-41ac-9ce9-40a62194e098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23194cba-841d-41ac-9ce9-40a62194e098', 'volume_size': 1}
Jun 17 04:22:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (e5de768d-3783-4a93-ab97-8a5e9f1b40d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8996bf8a-37a9-43cc-b546-ea7a8def84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8996bf8a-37a9-43cc-b546-ea7a8def84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862497608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f49601-678d-47c4-9269-5e5fda03d492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:20Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fcaa66-1357-4b31-9ab4-9cefd51908e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fcaa66-1357-4b31-9ab4-9cefd51908e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29768471-ac0c-4929-ae6f-7734f38ea486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29768471-ac0c-4929-ae6f-7734f38ea486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f49601-678d-47c4-9269-5e5fda03d492', 'volume_name': 'volume-04f49601-678d-47c4-9269-5e5fda03d492', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfa0663-c120-4abe-b978-f1d9e286a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfa0663-c120-4abe-b978-f1d9e286a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138314e7-251f-42cb-9bf2-9d1375beec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume 04f49601-678d-47c4-9269-5e5fda03d492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f49601-678d-47c4-9269-5e5fda03d492', 'volume_size': 1}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:20 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" returned: 0 in 0.655s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-27729166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3c0a19-da01-4de8-bb16-93bce41fe759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume ea3c0a19-da01-4de8-bb16-93bce41fe759 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:20 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64a023b-ff83-4b81-9fac-d5be01b7519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack sudo[110473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 1073741824
Jun 17 04:22:20 devstack sudo[110473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65a219d-9b7b-4324-8e4c-98658e0912ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 (5f09c8cd-0459-4de0-bb3a-4794dbbc2e65): created successfully
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65a219d-9b7b-4324-8e4c-98658e0912ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (6b2d45e7-4bbe-4d12-943a-b4e027c79074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:20 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-28034569-eff3-44f6-a903-14d9ac272429 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:21 devstack sudo[110473]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 1073741824" returned: 0 in 0.727s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:21 devstack sudo[110479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759
Jun 17 04:22:21 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:21 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759" returned: 0 in 0.597s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457491094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43099347-675c-4edf-8662-0c1c4e4ae366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:19Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume 43099347-675c-4edf-8662-0c1c4e4ae366 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:21 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286cd329-9212-467a-854c-b04f46524e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3c0a19-da01-4de8-bb16-93bce41fe759', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:21 devstack sudo[110482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 1073741824
Jun 17 04:22:21 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb16362-03d9-4be5-af46-7d5d1ee131e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 (ea3c0a19-da01-4de8-bb16-93bce41fe759): created successfully
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb16362-03d9-4be5-af46-7d5d1ee131e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (1ecd3ec4-a42e-470f-99d9-2b311615561f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:21 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-aa9feb0c-7582-440d-9e85-96f17d9dbf60 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:22 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 1073741824" returned: 0 in 0.751s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:22 devstack sudo[110487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366
Jun 17 04:22:22 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:23 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366" returned: 0 in 0.564s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.188s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508736365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23194cba-841d-41ac-9ce9-40a62194e098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:20Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume 23194cba-841d-41ac-9ce9-40a62194e098 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:23 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:23 devstack sudo[110490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 1073741824
Jun 17 04:22:23 devstack sudo[110490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721fd785-03fa-401f-b3ff-0e9b6143e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43099347-675c-4edf-8662-0c1c4e4ae366', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d3aff-61f2-4ccc-a9d0-275bb59cde35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:23 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-43099347-675c-4edf-8662-0c1c4e4ae366 (43099347-675c-4edf-8662-0c1c4e4ae366): created successfully
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d3aff-61f2-4ccc-a9d0-275bb59cde35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (4bf1d3dd-2d3c-4f65-8ae4-de349d3cac61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:23 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-25abca21-9851-4ff3-adbd-2308abec996b tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:23 devstack sudo[110490]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 1073741824" returned: 0 in 0.777s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:23 devstack sudo[110495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098
Jun 17 04:22:23 devstack sudo[110495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:24 devstack sudo[110495]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098" returned: 0 in 0.581s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.271s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862497608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f49601-678d-47c4-9269-5e5fda03d492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1bed9cdb94898ae1e69eb869e9e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:20Z,use_quota=True,user_id='195291f7de304d9a8dcb4fc4dcc36d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Creating volume 04f49601-678d-47c4-9269-5e5fda03d492 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:24 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f101601-206e-4878-8c37-85cc44fd3675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23194cba-841d-41ac-9ce9-40a62194e098', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac0c4f-c343-42e7-bb2b-76451894bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:24 devstack sudo[110498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 1073741824
Jun 17 04:22:24 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:24 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-23194cba-841d-41ac-9ce9-40a62194e098 (23194cba-841d-41ac-9ce9-40a62194e098): created successfully
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac0c4f-c343-42e7-bb2b-76451894bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (8e9a4f34-c268-47d3-bb7d-de583549d932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-51555a83-8aad-4ca8-ba6f-b953707e7024 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:25 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 1073741824" returned: 0 in 0.748s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:25 devstack sudo[110504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492
Jun 17 04:22:25 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:25 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138314e7-251f-42cb-9bf2-9d1375beec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f49601-678d-47c4-9269-5e5fda03d492', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3533ab69-c124-4828-9ce8-43204a0335c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Volume volume-04f49601-678d-47c4-9269-5e5fda03d492 (04f49601-678d-47c4-9269-5e5fda03d492): created successfully
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3533ab69-c124-4828-9ce8-43204a0335c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Flow 'volume_create_manager' (e5de768d-3783-4a93-ab97-8a5e9f1b40d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d34cb5d9-659f-4eed-ae69-30842ef5d659 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created volume successfully.
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-04f49601-678d-47c4-9269-5e5fda03d492-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-04f49601-678d-47c4-9269-5e5fda03d492-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-04f49601-678d-47c4-9269-5e5fda03d492" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-04f49601-678d-47c4-9269-5e5fda03d492" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad946b21-cfd4-4407-b641-1e0c4f7ca1c7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:26 devstack sudo[110508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492
Jun 17 04:22:26 devstack sudo[110508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:27 devstack sudo[110508]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492" returned: 0 in 0.681s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:27 devstack sudo[110513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492
Jun 17 04:22:27 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:27 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-04f49601-678d-47c4-9269-5e5fda03d492" returned: 0 in 0.566s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-04f49601-678d-47c4-9269-5e5fda03d492" released by "delete_volume" :: held 1.281s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['17dd6cf3-2a99-4eeb-b02f-3ee528031c42', '5ebf2e13-32ed-492e-8cf9-76a2f2dc4d1e', '7fd9ca90-5e35-47e6-a859-7b92b724458d', 'dee3c228-1369-407c-a356-d9db62434671'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:28 devstack sudo[110516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:28 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:28 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.560s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:28 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fb5de067-2670-4837-abc7-58505cc3be15 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-04f49601-678d-47c4-9269-5e5fda03d492-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-23194cba-841d-41ac-9ce9-40a62194e098-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-23194cba-841d-41ac-9ce9-40a62194e098-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-23194cba-841d-41ac-9ce9-40a62194e098" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-23194cba-841d-41ac-9ce9-40a62194e098" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90179eb-f0a4-42c4-a9ea-bedc26955f51]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:29 devstack sudo[110519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098
Jun 17 04:22:29 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:29 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:29 devstack sudo[110524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098
Jun 17 04:22:29 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:30 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-23194cba-841d-41ac-9ce9-40a62194e098" returned: 0 in 0.565s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-23194cba-841d-41ac-9ce9-40a62194e098" released by "delete_volume" :: held 1.274s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['a9734099-ff78-4975-84a7-be8675b30c6e', 'bd66b0a4-3fe4-412d-8472-8a64ae020577', '8254e64d-c8b1-4745-bbbc-b588880a598d', '8630e64c-02fd-4d1b-9635-7c2ab9ae7dc8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:30 devstack sudo[110527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:30 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:30 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.576s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:30 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-61796a40-beda-43a7-9f5e-e1d781c9385a tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-23194cba-841d-41ac-9ce9-40a62194e098-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-43099347-675c-4edf-8662-0c1c4e4ae366-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-43099347-675c-4edf-8662-0c1c4e4ae366-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-43099347-675c-4edf-8662-0c1c4e4ae366" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-43099347-675c-4edf-8662-0c1c4e4ae366" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfeffaa-5e10-4c4f-8423-98ed12cb27de]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:31 devstack sudo[110530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366
Jun 17 04:22:31 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:31 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366" returned: 0 in 0.690s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:31 devstack sudo[110535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366
Jun 17 04:22:31 devstack sudo[110535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:32 devstack sudo[110535]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-43099347-675c-4edf-8662-0c1c4e4ae366" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-43099347-675c-4edf-8662-0c1c4e4ae366" released by "delete_volume" :: held 1.331s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['a6964614-f81b-4e9a-afc9-a2b1595650a5', '107352d8-7c60-4f03-a501-9e288d38a00b', '0ce0d38a-9035-4d31-8829-1506d3a5e951', '972fbe17-edf5-4cb4-8abe-442d5fb0c79a'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:32 devstack sudo[110539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:32 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:33 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.601s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4b6cb90e-755e-4c06-9db8-a873638d38d6 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-43099347-675c-4edf-8662-0c1c4e4ae366-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-ea3c0a19-da01-4de8-bb16-93bce41fe759-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-ea3c0a19-da01-4de8-bb16-93bce41fe759-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-ea3c0a19-da01-4de8-bb16-93bce41fe759" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-ea3c0a19-da01-4de8-bb16-93bce41fe759" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124a8d0-4f13-449b-9388-f47e61301d91]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:33 devstack sudo[110548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759
Jun 17 04:22:33 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:34 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:34 devstack sudo[110554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759
Jun 17 04:22:34 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:34 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ea3c0a19-da01-4de8-bb16-93bce41fe759" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-ea3c0a19-da01-4de8-bb16-93bce41fe759" released by "delete_volume" :: held 1.403s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['e966bba3-9705-404a-8cdc-5d89ee531e03', '9e4b6f59-5e78-4872-a577-f4d65895735b', 'f2c2afe1-956c-4984-a85b-61419bdafd35', 'c1e7c118-698f-4d17-a00e-e375ce82eec5'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:34 devstack sudo[110557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:34 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:35 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.568s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d9dd1512-221b-443d-b308-17ee09477334 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-ea3c0a19-da01-4de8-bb16-93bce41fe759-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443ca58-c3b6-4aa1-a9de-2b133dbe77b8]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:35 devstack sudo[110560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65
Jun 17 04:22:35 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:36 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" returned: 0 in 0.676s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:36 devstack sudo[110566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65
Jun 17 04:22:36 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:36 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" returned: 0 in 0.593s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65" released by "delete_volume" :: held 1.311s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:36 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['8dbb2bbf-559f-4a41-9222-56011123d0e3', '401254c6-6efc-416b-a40c-6308c03148d6', '9683c3bc-431e-4e9e-b2fd-b5d210a89e11', 'f1d52376-06f7-4c6c-bcee-7ee5f2bc2eac'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:37 devstack sudo[110569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:37 devstack sudo[110569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:37 devstack sudo[110569]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.588s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa50cb14-36a9-40cb-ba68-5c5b406dd9de tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-5f09c8cd-0459-4de0-bb3a-4794dbbc2e65-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-4d191b8c-5c26-4bb9-9c8e-734b9804afa1-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-4d191b8c-5c26-4bb9-9c8e-734b9804afa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-4d191b8c-5c26-4bb9-9c8e-734b9804afa1" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-4d191b8c-5c26-4bb9-9c8e-734b9804afa1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleting offline snapshot 4d191b8c-5c26-4bb9-9c8e-734b9804afa1 of volume 6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] snapshot_file for this snap is: volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5369c1-bd61-4f17-8102-1a785b4fb0d3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:37 devstack sudo[110572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1
Jun 17 04:22:37 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:38 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1" returned: 0 in 0.683s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6efa8f12-d277-45df-96df-f6c7e9a51a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:22:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4c7b6-bcba-4d12-b1dd-4e4a49e253fa]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:38 devstack sudo[110577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19
Jun 17 04:22:38 devstack sudo[110577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:39 devstack sudo[110577]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19" returned: 0 in 0.729s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:39 devstack sudo[110582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1
Jun 17 04:22:39 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:39 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1" returned: 0 in 0.702s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:39 devstack sudo[110588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1
Jun 17 04:22:39 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:40 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19.4d191b8c-5c26-4bb9-9c8e-734b9804afa1" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-4d191b8c-5c26-4bb9-9c8e-734b9804afa1" released by "_delete_snapshot" :: held 2.787s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" released by "delete_snapshot" :: held 2.808s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['42899fb1-af74-494d-b969-f462250f7abe', '2b4ba775-9e64-4b2d-8d08-763e25edf909', '5ff62a78-8503-478f-991f-c023a2ca19ec', 'cf8e846f-2ddf-4307-9871-3ea06de5c0a7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:40 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Delete snapshot completed successfully.
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b1c95d59-9b8c-49df-83cb-fe54c8bb5dbc tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-4d191b8c-5c26-4bb9-9c8e-734b9804afa1-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-6efa8f12-d277-45df-96df-f6c7e9a51a19-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-6efa8f12-d277-45df-96df-f6c7e9a51a19-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:41 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a249a9-291b-4119-bb1c-8685341e79b9]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:41 devstack sudo[110591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19
Jun 17 04:22:41 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:41 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19" returned: 0 in 0.661s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:41 devstack sudo[110596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19
Jun 17 04:22:41 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:42 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-6efa8f12-d277-45df-96df-f6c7e9a51a19" returned: 0 in 0.574s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-quobyte-6efa8f12-d277-45df-96df-f6c7e9a51a19" released by "delete_volume" :: held 1.289s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Created reservations ['f34445c2-037b-4acd-8ca7-1e4437699bff', '6fca111e-1ed9-4578-b19c-6e3195c8c7ed', '1875696d-de21-461c-8d27-523449cde98b', '56db5597-fe85-4e1d-9607-0c92490938af'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:42 devstack sudo[110599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:22:42 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:42 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.557s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:22:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Deleted volume successfully.
Jun 17 04:22:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5e875be8-b863-41e1-b49e-0a7da4a5b7c0 tempest-CreateVolumesFromSnapshotTest-1613173044 None] Lock "cinder-6efa8f12-d277-45df-96df-f6c7e9a51a19-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Flow 'volume_create_manager' (883bb9fb-d620-4f33-97f7-e3be834b8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecafc219-447d-41bb-b26e-e6823999f929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecafc219-447d-41bb-b26e-e6823999f929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827756165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146e075c-6cf9-4603-a632-e1ddbe54bcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4308f45e447cb8b2ffb6b32cdc4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:45Z,use_quota=True,user_id='2b4036a97d5e4069a7662da3bef43d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9d2b7a-128f-40fc-983b-5a339491e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9d2b7a-128f-40fc-983b-5a339491e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330309a0-e54a-4c2d-b25e-1f729ac7b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330309a0-e54a-4c2d-b25e-1f729ac7b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146e075c-6cf9-4603-a632-e1ddbe54bcfd', 'volume_name': 'volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5589a1-d432-418d-9536-a2066950757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5589a1-d432-418d-9536-a2066950757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e268bdcd-319c-48b9-8732-5f1dd5577ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:45 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Volume 146e075c-6cf9-4603-a632-e1ddbe54bcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd', 'volume_size': 1}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827756165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146e075c-6cf9-4603-a632-e1ddbe54bcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4308f45e447cb8b2ffb6b32cdc4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:45Z,use_quota=True,user_id='2b4036a97d5e4069a7662da3bef43d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Creating volume 146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:45 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:22:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:45 devstack sudo[110602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd 1073741824
Jun 17 04:22:45 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:46 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd 1073741824" returned: 0 in 0.747s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:46 devstack sudo[110609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:22:46 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:46 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e268bdcd-319c-48b9-8732-5f1dd5577ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079cb93-270b-4499-9da9-f22f2057324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:46 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Volume volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd (146e075c-6cf9-4603-a632-e1ddbe54bcfd): created successfully
Jun 17 04:22:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079cb93-270b-4499-9da9-f22f2057324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Flow 'volume_create_manager' (883bb9fb-d620-4f33-97f7-e3be834b8836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a58c163d-85c6-4e0b-9b21-015a5d9bf9d3 tempest-VolumeDependencyTests-815567519 None] Created volume successfully.
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Creating offline snapshot ef32ef9a-0bf5-4db6-90f0-6df238419013 of volume 146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5314c454-dc61-48f5-9ae9-e21cf8e8c4e3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:47 devstack sudo[110612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:22:47 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:48 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.713s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:48 devstack sudo[110617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 1G
Jun 17 04:22:48 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:49 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 1G" returned: 0 in 0.729s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:49 devstack sudo[110622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:22:49 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:49 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.606s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:49 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 is being set with open permissions: ugo+rw
Jun 17 04:22:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:49 devstack sudo[110627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:22:49 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:50 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.560s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:50 devstack sudo[110630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info
Jun 17 04:22:50 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:51 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info" returned: 0 in 0.585s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:51 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info is being set with open permissions: ugo+rw
Jun 17 04:22:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:51 devstack sudo[110633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info
Jun 17 04:22:51 devstack sudo[110633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:51 devstack sudo[110633]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.info" returned: 0 in 0.610s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.882s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7f14c975-ba67-4f84-9b56-fbf7576db3e5 tempest-VolumeDependencyTests-815567519 None] Create snapshot completed successfully
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Flow 'volume_create_manager' (66ab8ee9-cf2b-4539-85bf-3a4b155a0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2f9c2-fc3a-4e37-a654-5a2812228e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2f9c2-fc3a-4e37-a654-5a2812228e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1737570459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df3ea4a-2337-49d2-bd59-b90ca02c00bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4308f45e447cb8b2ffb6b32cdc4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef32ef9a-0bf5-4db6-90f0-6df238419013,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:22:52Z,use_quota=True,user_id='2b4036a97d5e4069a7662da3bef43d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93215d86-edd0-43fa-8715-a169e68e81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93215d86-edd0-43fa-8715-a169e68e81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382212a3-7d51-4f83-8b79-1e2e82a74e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382212a3-7d51-4f83-8b79-1e2e82a74e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4df3ea4a-2337-49d2-bd59-b90ca02c00bf', 'volume_name': 'volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf', 'volume_size': 1, 'snapshot_id': 'ef32ef9a-0bf5-4db6-90f0-6df238419013'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2c86d-0917-4308-8f74-db83996e2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2c86d-0917-4308-8f74-db83996e2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c41e16-6e2b-42db-b84c-2c035af51cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:52 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Volume 4df3ea4a-2337-49d2-bd59-b90ca02c00bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf', 'volume_size': 1, 'snapshot_id': 'ef32ef9a-0bf5-4db6-90f0-6df238419013'}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Creating volume 4df3ea4a-2337-49d2-bd59-b90ca02c00bf from snapshot ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] snapshot: ef32ef9a-0bf5-4db6-90f0-6df238419013, volume: 4df3ea4a-2337-49d2-bd59-b90ca02c00bf,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a90d03-e4a5-4e16-80a0-313a7bee8abb]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:52 devstack sudo[110672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:22:52 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:53 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.684s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cfa44b-4a3e-4bd1-8fbe-ef5b24a41ae5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:53 devstack sudo[110677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:22:53 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:53 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:22:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:53 devstack sudo[110682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf
Jun 17 04:22:53 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:58 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" returned: 0 in 4.333s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923ff36-c120-4343-a4cf-208175b670e0]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:22:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:58 devstack sudo[110698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:22:58 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:59 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.888s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:22:59 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Converted 1024.00 MB image at 236.25 MB/s
Jun 17 04:22:59 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf is being set with open permissions: ugo+rw
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:22:59 devstack sudo[110703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf
Jun 17 04:22:59 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:22:59 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" returned: 0 in 0.598s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" released by "_copy_volume_from_snapshot" :: held 7.274s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" released by "_create_volume_from_snapshot" :: held 7.303s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.318s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=73,cinder:UPDATE=93,cinder:DELETE=12,cinder:INSERT=25 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=99,cinder:INSERT=22,cinder:DELETE=6,cinder:SELECT=76 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c41e16-6e2b-42db-b84c-2c035af51cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf', 'volume_size': 1, 'snapshot_id': 'ef32ef9a-0bf5-4db6-90f0-6df238419013'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1ff1df-4f85-459c-90fb-004d7a19d8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:22:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Volume volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf (4df3ea4a-2337-49d2-bd59-b90ca02c00bf): created successfully
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1ff1df-4f85-459c-90fb-004d7a19d8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:22:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Flow 'volume_create_manager' (66ab8ee9-cf2b-4539-85bf-3a4b155a0a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:22:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-808195d6-b7d9-4cc9-827f-a79b6634a296 tempest-VolumeDependencyTests-815567519 None] Created volume successfully.
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-ef32ef9a-0bf5-4db6-90f0-6df238419013-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-ef32ef9a-0bf5-4db6-90f0-6df238419013-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Deleting offline snapshot ef32ef9a-0bf5-4db6-90f0-6df238419013 of volume 146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] snapshot_file for this snap is: volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce822dc3-2d6e-419b-a782-c3842a835e69]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:00 devstack sudo[110706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:23:00 devstack sudo[110706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:00 devstack sudo[110706]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.688s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf59bd0-ce9c-4ee0-ba71-d0501ea816f3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:00 devstack sudo[110711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:23:00 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:01 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.709s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:01 devstack sudo[110717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:23:01 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:02 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.677s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:02 devstack sudo[110722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013
Jun 17 04:23:02 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:02 devstack sudo[110724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:23:02 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:02 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd.ef32ef9a-0bf5-4db6-90f0-6df238419013" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:02 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.641s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-ef32ef9a-0bf5-4db6-90f0-6df238419013" released by "_delete_snapshot" :: held 2.799s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" released by "delete_snapshot" :: held 2.826s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Created reservations ['4d435e93-43fd-4747-b9a7-e791e5dff2ac', 'bd308cec-7c69-4621-816f-4be5cae0781c', '3e508f5c-30fa-4045-b1dc-9ae5c8b0c459', '23325c4d-bed5-4a85-a623-ce4615073513'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:23:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Delete snapshot completed successfully.
Jun 17 04:23:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2afcc5dd-f935-407d-ab2c-a88b84845881 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-ef32ef9a-0bf5-4db6-90f0-6df238419013-delete_snapshot" released by "delete_snapshot" :: held 2.953s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-146e075c-6cf9-4603-a632-e1ddbe54bcfd-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-146e075c-6cf9-4603-a632-e1ddbe54bcfd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2d9ea-6fc5-4511-b95f-ce210b5f555b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:03 devstack sudo[110728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:23:03 devstack sudo[110728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:03 devstack sudo[110728]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:03 devstack sudo[110733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd
Jun 17 04:23:03 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:04 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-146e075c-6cf9-4603-a632-e1ddbe54bcfd" returned: 0 in 0.572s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-146e075c-6cf9-4603-a632-e1ddbe54bcfd" released by "delete_volume" :: held 1.295s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Created reservations ['8bf1cfa4-7263-4257-bf88-6bf99b0015bc', '3738556f-f5c4-41c5-9c69-b9d4532e019a', '99e9876a-a97f-461d-8738-77dbe32bcb4f', '2583e5a9-0744-4ca1-9b1d-897653fcda80'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:04 devstack sudo[110736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:23:04 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:05 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.557s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:23:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Deleted volume successfully.
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-91757769-a542-4850-a205-96a96f8416b0 tempest-VolumeDependencyTests-815567519 None] Lock "cinder-146e075c-6cf9-4603-a632-e1ddbe54bcfd-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-4df3ea4a-2337-49d2-bd59-b90ca02c00bf-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "cinder-4df3ea4a-2337-49d2-bd59-b90ca02c00bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Acquiring lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" acquired by "delete_volume" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e405627-fda8-48d6-8f99-259fa19edc1c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:05 devstack sudo[110739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf
Jun 17 04:23:05 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:06 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:06 devstack sudo[110745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf
Jun 17 04:23:06 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:06 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" returned: 0 in 0.565s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "cinder-quobyte-4df3ea4a-2337-49d2-bd59-b90ca02c00bf" released by "delete_volume" :: held 1.297s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Created reservations ['81c10604-17fa-4188-8cd9-cf9c9ecc5075', 'e4374cf8-53c2-43ff-b967-3df0df0abee6', '3e3c229a-cf70-48c9-b051-cb271712133f', '1d9f35f3-005c-4902-a140-d570562f0e10'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:06 devstack sudo[110748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:23:06 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:07 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.567s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:07 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:23:07 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Deleted volume successfully.
Jun 17 04:23:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-cb2f2aa7-054d-4b0a-be26-f033a0a3a0ee tempest-VolumeDependencyTests-815567519 None] Lock "cinder-4df3ea4a-2337-49d2-bd59-b90ca02c00bf-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Flow 'volume_create_manager' (adc0d3e7-090a-4411-9336-6ef45f39b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de47ada-43d1-4400-86e8-efa31be45655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de47ada-43d1-4400-86e8-efa31be45655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdff2e5-48ce-4079-bbf1-45ef2ae73bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad331e42d7c478fa9f3e8f17a9880ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:23:12Z,use_quota=True,user_id='cb22dd4a2f1f41b084cc39f6409b1955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eb741e-b67c-4558-b488-58bce09d6fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eb741e-b67c-4558-b488-58bce09d6fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28aa10-d61e-4f92-a710-b840351b2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28aa10-d61e-4f92-a710-b840351b2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfdff2e5-48ce-4079-bbf1-45ef2ae73bda', 'volume_name': 'volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda', 'volume_size': 1, 'image_id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b670cfbf905b02c32664634038df14a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad331e42d7c478fa9f3e8f17a9880ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '482b10a5283de18d24863491b0346970f9d1342731af81544fd2ef91d98b8206ee0aa926902e56313c4245f15d0f1b1f8569a5fcda7d925a3533c025da65adf4', 'id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'created_at': datetime.datetime(2026, 6, 17, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9e9644-a2a6-4135-897a-4d7d6744be30/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b51ed80>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d1a44f-cf53-47a9-8ce8-a6f0518dfa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d1a44f-cf53-47a9-8ce8-a6f0518dfa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a564f4-2040-4143-9f09-93466f453483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:12 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda', 'volume_size': 1, 'image_id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b670cfbf905b02c32664634038df14a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad331e42d7c478fa9f3e8f17a9880ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '482b10a5283de18d24863491b0346970f9d1342731af81544fd2ef91d98b8206ee0aa926902e56313c4245f15d0f1b1f8569a5fcda7d925a3533c025da65adf4', 'id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'created_at': datetime.datetime(2026, 6, 17, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9e9644-a2a6-4135-897a-4d7d6744be30/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b51ed80>}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Trying to clone cfdff2e5-48ce-4079-bbf1-45ef2ae73bda from image ca9e9644-a2a6-4135-897a-4d7d6744be30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:23:12 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Image download 0.00 MB at 0.00 MB/s
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[007183ee-37bf-4cd3-80b2-382d4e3a6c7a]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:12 devstack sudo[110752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:12 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:13 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 0 in 0.646s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:13 devstack sudo[110756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:13 devstack sudo[110756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:13 devstack sudo[110756]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 1 in 0.643s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Temporary image ca9e9644-a2a6-4135-897a-4d7d6744be30 is fetched for user cb22dd4a2f1f41b084cc39f6409b1955. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d18a8a-f494-463a-9edc-cd16418b33f3]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:14 devstack sudo[110761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:14 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:14 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 0 in 0.649s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:14 devstack sudo[110765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:14 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:15 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 1 in 0.635s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdff2e5-48ce-4079-bbf1-45ef2ae73bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad331e42d7c478fa9f3e8f17a9880ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:23:12Z,use_quota=True,user_id='cb22dd4a2f1f41b084cc39f6409b1955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Creating volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:23:15 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:15 devstack sudo[110770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1073741824
Jun 17 04:23:15 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:15 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1073741824" returned: 0 in 0.726s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:15 devstack sudo[110775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:15 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:16 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 0 in 0.560s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Attempting download of ca9e9644-a2a6-4135-897a-4d7d6744be30 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}])) to volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e250fd6e-0d20-4258-848a-953cb3fdc370]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:16 devstack sudo[110779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og
Jun 17 04:23:16 devstack sudo[110779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:17 devstack sudo[110779]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:17 devstack sudo[110783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og
Jun 17 04:23:17 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:17 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og" returned: 1 in 0.666s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9e9644-a2a6-4135-897a-4d7d6744be30_k5so13og' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac52a2b-3606-4efa-b1e9-e8ab59ea69a8]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:18 devstack sudo[110787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:18 devstack sudo[110787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:18 devstack sudo[110787]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:18 devstack sudo[110791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD
Jun 17 04:23:18 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:19 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD" returned: 1 in 0.646s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] ca9e9644-a2a6-4135-897a-4d7d6744be30 was raw, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:19 devstack sudo[110796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:19 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:19 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 0 in 0.646s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca9e9644-a2a6-4135-897a-4d7d6744be30_rse8_uo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:23:19 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Converted 0.00 MB image at 0.00 MB/s
Jun 17 04:23:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:19 devstack sudo[110801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1G
Jun 17 04:23:19 devstack sudo[110801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:20 devstack sudo[110801]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda 1G" returned: 0 in 0.600s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:20 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[883151df-211a-4637-b189-7b8c8c8ed94a]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:20 devstack sudo[110806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:20 devstack sudo[110806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:21 devstack sudo[110806]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:21 devstack sudo[110810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:21 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:21 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 1 in 0.684s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Downloaded image ca9e9644-a2a6-4135-897a-4d7d6744be30 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}])) to volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Temporary image ca9e9644-a2a6-4135-897a-4d7d6744be30 for user cb22dd4a2f1f41b084cc39f6409b1955 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Marking volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Copying metadata from image ca9e9644-a2a6-4135-897a-4d7d6744be30 to cfdff2e5-48ce-4079-bbf1-45ef2ae73bda. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Creating volume glance metadata for volume cfdff2e5-48ce-4079-bbf1-45ef2ae73bda backed by image ca9e9644-a2a6-4135-897a-4d7d6744be30 with: {'image_id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b670cfbf905b02c32664634038df14a4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a564f4-2040-4143-9f09-93466f453483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda', 'volume_size': 1, 'image_id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9e9644-a2a6-4135-897a-4d7d6744be30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b670cfbf905b02c32664634038df14a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad331e42d7c478fa9f3e8f17a9880ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '482b10a5283de18d24863491b0346970f9d1342731af81544fd2ef91d98b8206ee0aa926902e56313c4245f15d0f1b1f8569a5fcda7d925a3533c025da65adf4', 'id': 'ca9e9644-a2a6-4135-897a-4d7d6744be30', 'created_at': datetime.datetime(2026, 6, 17, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9e9644-a2a6-4135-897a-4d7d6744be30/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b51ed80>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f733b4b-4f4f-4bcc-8d21-ead9f303621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Volume volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda (cfdff2e5-48ce-4079-bbf1-45ef2ae73bda): created successfully
Jun 17 04:23:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f733b4b-4f4f-4bcc-8d21-ead9f303621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Flow 'volume_create_manager' (adc0d3e7-090a-4411-9336-6ef45f39b58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:23:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-e8b53da8-f524-4bf9-a8a4-aadf002e7d55 tempest-VolumeImageDependencyTests-1139431353 None] Created volume successfully.
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Acquiring lock "cinder-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "cinder-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Acquiring lock "cinder-quobyte-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "cinder-quobyte-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a25293-21f8-4659-8b19-f0280de72fc1]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:23 devstack sudo[110815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:23 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:23 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 0 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:23 devstack sudo[110819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:23 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:24 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 1 in 0.667s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:24 devstack sudo[110824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda
Jun 17 04:23:24 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:24 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" returned: 0 in 0.573s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "cinder-quobyte-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda" released by "delete_volume" :: held 2.001s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:24 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Created reservations ['a0276864-64a4-435f-95f6-3515bcba9bd3', 'bd123501-3f17-44a6-93a4-b7ce7facfff7', 'aa8a627b-8e77-43d4-bdc0-f216b6c2bce8', '21283076-8fff-42f3-9043-7c464986fa1d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:25 devstack sudo[110827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:23:25 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:25 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.570s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:23:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Deleted volume successfully.
Jun 17 04:23:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-01020437-9801-4b96-8fef-a301f2ac7822 tempest-VolumeImageDependencyTests-1139431353 None] Lock "cinder-cfdff2e5-48ce-4079-bbf1-45ef2ae73bda-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:23:35 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:DELETE=3,cinder:SELECT=26,cinder:INSERT=18,cinder:UPDATE=29 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:23:35 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=42,cinder:SELECT=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Flow 'volume_create_manager' (69ccfa40-5965-4d35-9db4-0f226e9361cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e38d65-c407-408c-a7e0-1301727e6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e38d65-c407-408c-a7e0-1301727e6042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-607200874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c616b525-6811-4b5d-96eb-c5583e147cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef11d10a9354791a9f2a9a023946df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:23:48Z,use_quota=True,user_id='a867d277adf847ac99b27c2a7fcfc204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba24cd9-eacc-465c-a1d0-580606482312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba24cd9-eacc-465c-a1d0-580606482312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe5ca61-03cc-46e1-98e3-bdf00001d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe5ca61-03cc-46e1-98e3-bdf00001d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c616b525-6811-4b5d-96eb-c5583e147cee', 'volume_name': 'volume-c616b525-6811-4b5d-96eb-c5583e147cee', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a75347-8b87-438c-be2d-343a26f75976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a75347-8b87-438c-be2d-343a26f75976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2420ae9-7863-44b5-a31e-478ab8768150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:48 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Volume c616b525-6811-4b5d-96eb-c5583e147cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c616b525-6811-4b5d-96eb-c5583e147cee', 'volume_size': 1}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-607200874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c616b525-6811-4b5d-96eb-c5583e147cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef11d10a9354791a9f2a9a023946df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:23:48Z,use_quota=True,user_id='a867d277adf847ac99b27c2a7fcfc204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Creating volume c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:23:48 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:23:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:48 devstack sudo[110842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee 1073741824
Jun 17 04:23:48 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:49 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee 1073741824" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:49 devstack sudo[110848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:23:49 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:49 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.577s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2420ae9-7863-44b5-a31e-478ab8768150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c616b525-6811-4b5d-96eb-c5583e147cee', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4a9e78-52d6-455f-a8b7-6f25620f6fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:49 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Volume volume-c616b525-6811-4b5d-96eb-c5583e147cee (c616b525-6811-4b5d-96eb-c5583e147cee): created successfully
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4a9e78-52d6-455f-a8b7-6f25620f6fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Flow 'volume_create_manager' (69ccfa40-5965-4d35-9db4-0f226e9361cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:23:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-962c70cb-7e52-44da-a243-ac850bde9c95 tempest-SnapshotDependencyTests-410590993 None] Created volume successfully.
Jun 17 04:23:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Creating offline snapshot 56bf4e0c-38b3-437a-8915-27f2ad3c0903 of volume c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:23:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0beae5-32e6-4096-ac2d-5019b83b39aa]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:50 devstack sudo[110851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:23:50 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:51 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.662s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:51 devstack sudo[110856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 1G
Jun 17 04:23:51 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:52 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 1G" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c616b525-6811-4b5d-96eb-c5583e147cee -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:52 devstack sudo[110897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c616b525-6811-4b5d-96eb-c5583e147cee -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:23:52 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:52 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c616b525-6811-4b5d-96eb-c5583e147cee -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:52 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 is being set with open permissions: ugo+rw
Jun 17 04:23:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:52 devstack sudo[110902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:23:52 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:53 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.562s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:53 devstack sudo[110905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info
Jun 17 04:23:53 devstack sudo[110905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:53 devstack sudo[110905]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info" returned: 0 in 0.584s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:53 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info is being set with open permissions: ugo+rw
Jun 17 04:23:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:53 devstack sudo[110908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info
Jun 17 04:23:53 devstack sudo[110908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:54 devstack sudo[110908]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.info" returned: 0 in 0.574s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.849s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:54 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3eaa42d1-fb3e-49b1-a94f-7cdb93e5d4e8 tempest-SnapshotDependencyTests-410590993 None] Create snapshot completed successfully
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Flow 'volume_create_manager' (90caef46-5376-469e-bff6-bdf228c09403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4737c1b5-340e-4eb6-98df-0df998122b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4737c1b5-340e-4eb6-98df-0df998122b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064d61e1-049f-4013-8208-9c999dce1c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef11d10a9354791a9f2a9a023946df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=56bf4e0c-38b3-437a-8915-27f2ad3c0903,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:23:55Z,use_quota=True,user_id='a867d277adf847ac99b27c2a7fcfc204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d18d1e2-a0e4-499c-b4e1-f5368950385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d18d1e2-a0e4-499c-b4e1-f5368950385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68bc1ff-fb12-438e-a5cd-a159fde3f59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68bc1ff-fb12-438e-a5cd-a159fde3f59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '064d61e1-049f-4013-8208-9c999dce1c5f', 'volume_name': 'volume-064d61e1-049f-4013-8208-9c999dce1c5f', 'volume_size': 1, 'snapshot_id': '56bf4e0c-38b3-437a-8915-27f2ad3c0903'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e1713d-b867-4bc9-aeac-d41221224ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e1713d-b867-4bc9-aeac-d41221224ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57142994-b0db-47cd-a559-f70a1bd8161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:23:55 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Volume 064d61e1-049f-4013-8208-9c999dce1c5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-064d61e1-049f-4013-8208-9c999dce1c5f', 'volume_size': 1, 'snapshot_id': '56bf4e0c-38b3-437a-8915-27f2ad3c0903'}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903-064d61e1-049f-4013-8208-9c999dce1c5f" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903-064d61e1-049f-4013-8208-9c999dce1c5f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Creating volume 064d61e1-049f-4013-8208-9c999dce1c5f from snapshot 56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] snapshot: 56bf4e0c-38b3-437a-8915-27f2ad3c0903, volume: 064d61e1-049f-4013-8208-9c999dce1c5f,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2dcc7a-d612-4559-88f4-9880c73c9342]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:55 devstack sudo[110912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:23:55 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:56 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.678s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c616b525-6811-4b5d-96eb-c5583e147cee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9cf5f-ba1b-4604-8300-971d0ea26d5d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:56 devstack sudo[110918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:23:56 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:23:56 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.692s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:23:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:23:56 devstack sudo[110923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f
Jun 17 04:23:56 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:01 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f" returned: 0 in 4.229s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12a3b5-b5e8-49dd-aab3-3ecfff748e84]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:01 devstack sudo[110938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:24:01 devstack sudo[110938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:01 devstack sudo[110938]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.873s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:01 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:24:01 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Converted 1024.00 MB image at 242.07 MB/s
Jun 17 04:24:01 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f is being set with open permissions: ugo+rw
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:02 devstack sudo[110943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f
Jun 17 04:24:02 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:02 devstack sudo[110945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:02 devstack sudo[110945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:02 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f" returned: 0 in 0.569s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" released by "_copy_volume_from_snapshot" :: held 7.129s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903-064d61e1-049f-4013-8208-9c999dce1c5f" released by "_create_volume_from_snapshot" :: held 7.156s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.169s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57142994-b0db-47cd-a559-f70a1bd8161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064d61e1-049f-4013-8208-9c999dce1c5f', 'volume_size': 1, 'snapshot_id': '56bf4e0c-38b3-437a-8915-27f2ad3c0903'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ad5e13-9623-49b6-aa89-3aad9a1dc37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:02 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Volume volume-064d61e1-049f-4013-8208-9c999dce1c5f (064d61e1-049f-4013-8208-9c999dce1c5f): created successfully
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ad5e13-9623-49b6-aa89-3aad9a1dc37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Flow 'volume_create_manager' (90caef46-5376-469e-bff6-bdf228c09403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-53722169-f8e0-48d9-9d7a-8d4a37ead37f tempest-SnapshotDependencyTests-410590993 None] Created volume successfully.
Jun 17 04:24:02 devstack sudo[110945]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.587s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:24:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-56bf4e0c-38b3-437a-8915-27f2ad3c0903-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-56bf4e0c-38b3-437a-8915-27f2ad3c0903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Deleting offline snapshot 56bf4e0c-38b3-437a-8915-27f2ad3c0903 of volume c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] snapshot_file for this snap is: volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce66faa8-a00b-4b70-9dd5-c7c37afcaa71]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:03 devstack sudo[110949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:24:03 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:03 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c616b525-6811-4b5d-96eb-c5583e147cee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66236c7-8f61-488c-ac82-b87119685ea5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:03 devstack sudo[110954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:24:03 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:04 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.676s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:04 devstack sudo[110959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:24:04 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:05 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.657s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:05 devstack sudo[110964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903
Jun 17 04:24:05 devstack sudo[110964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:05 devstack sudo[110964]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee.56bf4e0c-38b3-437a-8915-27f2ad3c0903" returned: 0 in 0.571s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-56bf4e0c-38b3-437a-8915-27f2ad3c0903" released by "_delete_snapshot" :: held 2.709s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" released by "delete_snapshot" :: held 2.730s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Created reservations ['1ae5e46c-b0d9-41d4-b94d-0ce06c946aef', 'b060a2d8-3a36-4548-a65e-eddab6f97ea0', '9b7be921-5cda-4f00-b0be-cfdbf203bc38', '1aba03ff-4444-4680-85a3-820a701f7809'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Delete snapshot completed successfully.
Jun 17 04:24:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-86b6e0f2-525a-4894-9509-65e2e73bfae2 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-56bf4e0c-38b3-437a-8915-27f2ad3c0903-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-c616b525-6811-4b5d-96eb-c5583e147cee-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-c616b525-6811-4b5d-96eb-c5583e147cee-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b84f0c-f4f4-4e21-b6c7-548b614a2b9b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:06 devstack sudo[110968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:24:06 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:06 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.669s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:06 devstack sudo[110973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee
Jun 17 04:24:06 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:07 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c616b525-6811-4b5d-96eb-c5583e147cee" returned: 0 in 0.603s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-c616b525-6811-4b5d-96eb-c5583e147cee" released by "delete_volume" :: held 1.327s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Created reservations ['5ffaf769-2065-41bc-85f0-3fa308fde70a', '4c3c461c-a9a1-42f3-bbaf-4f1a66cd16ba', '944687de-aa48-4ec8-81a9-472c87dd072e', 'b2322aa5-c48b-4794-b684-8dba4f13f680'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:07 devstack sudo[110976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:07 devstack sudo[110976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:08 devstack sudo[110976]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.564s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:08 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Deleted volume successfully.
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-33a0a3ef-9b4a-4286-b489-2287b96c448f tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-c616b525-6811-4b5d-96eb-c5583e147cee-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-064d61e1-049f-4013-8208-9c999dce1c5f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-064d61e1-049f-4013-8208-9c999dce1c5f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" acquired by "delete_volume" :: waited 0.013s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035496e-a80e-4065-8dc8-bb3db6e73be7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:08 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:08 devstack sudo[110979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f
Jun 17 04:24:08 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:09 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f" returned: 0 in 0.675s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:09 devstack sudo[110984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f
Jun 17 04:24:09 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:09 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-064d61e1-049f-4013-8208-9c999dce1c5f" returned: 0 in 0.583s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-quobyte-064d61e1-049f-4013-8208-9c999dce1c5f" released by "delete_volume" :: held 1.295s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Created reservations ['915b3dca-4e6e-4f96-8d1c-abf49317d482', '1aebefb4-503b-4eb4-bb8f-4e65575dff2e', 'ab1013c2-fb06-4d86-a644-ce4ce6152319', 'daf9e9ee-11e6-45b8-a7d9-38008270d678'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:09 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:09 devstack sudo[110987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:09 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:10 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:10 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.591s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:10 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:10 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Deleted volume successfully.
Jun 17 04:24:10 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-27289c80-60b5-4f56-aae8-15e04d3a3eb6 tempest-SnapshotDependencyTests-410590993 None] Lock "cinder-064d61e1-049f-4013-8208-9c999dce1c5f-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:19 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:24:20 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=5 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (6a6bdf3f-e65d-4a94-b860-abb01367079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77705274-3ea7-4cb5-8b59-98e21f49dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77705274-3ea7-4cb5-8b59-98e21f49dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317253033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a23037a-1e09-485e-92bb-753a07e600ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a23037a-1e09-485e-92bb-753a07e600ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c6b581-a331-445c-a890-3aa9e10585a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c6b581-a331-445c-a890-3aa9e10585a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2', 'volume_name': 'volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8232b9b0-40f1-4f2b-be8a-b590d5dab483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8232b9b0-40f1-4f2b-be8a-b590d5dab483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfac255-4b7c-4889-ad55-2ef942907b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Volume d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2', 'volume_size': 1}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317253033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Creating volume d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:28 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:28 devstack sudo[111036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 1073741824
Jun 17 04:24:28 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Flow 'volume_create_manager' (904e0f59-d1a1-4730-829a-169447ee2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2381c8a4-fdd0-4d73-8ff2-c44a05b38427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2381c8a4-fdd0-4d73-8ff2-c44a05b38427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a740490-105f-4d28-b00f-94dd1e580329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718913f9c7804aebb697d14bf07eb011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='25f780fec3dd48d2bc38382a36a70d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66646c53-3057-4c5a-8f51-cf847b3ea672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66646c53-3057-4c5a-8f51-cf847b3ea672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681748e-6002-47d1-95d6-60c7f68c3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681748e-6002-47d1-95d6-60c7f68c3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a740490-105f-4d28-b00f-94dd1e580329', 'volume_name': 'volume-4a740490-105f-4d28-b00f-94dd1e580329', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ef8865-9af7-477c-863f-53172d269e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ef8865-9af7-477c-863f-53172d269e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f551b2-b514-4b33-93ca-7ee8088f5403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:28 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Volume 4a740490-105f-4d28-b00f-94dd1e580329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a740490-105f-4d28-b00f-94dd1e580329', 'volume_size': 1}
Jun 17 04:24:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (63971f2a-cd43-4ab1-92d1-abb29ad33bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815fa84f-e203-4264-8b9f-161e58c0d891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815fa84f-e203-4264-8b9f-161e58c0d891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728513067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671a4e42-92e7-4aeb-b375-ee3862ccbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9e88b7-1e16-4ff7-b40d-5a30da7f6a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9e88b7-1e16-4ff7-b40d-5a30da7f6a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597dbb3-b455-431a-aecd-7d32074e53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597dbb3-b455-431a-aecd-7d32074e53fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671a4e42-92e7-4aeb-b375-ee3862ccbb84', 'volume_name': 'volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179cb4ff-1a46-4182-b33c-f718b3974e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179cb4ff-1a46-4182-b33c-f718b3974e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a98532-5f4b-478d-850f-15ab3f1b7db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Volume 671a4e42-92e7-4aeb-b375-ee3862ccbb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84', 'volume_size': 1}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (3e217437-430a-444e-af5f-8870c16f9e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda97709-a1ff-43fe-ad65-5a80635c7948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda97709-a1ff-43fe-ad65-5a80635c7948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1928099950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6559ee9-e2ce-4c4a-af19-9ede8d21f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6559ee9-e2ce-4c4a-af19-9ede8d21f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f01aa-f7ae-4363-a57c-5d6987b87c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f01aa-f7ae-4363-a57c-5d6987b87c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f25cca-c28f-4152-8fcf-59c9ac6dd4d7', 'volume_name': 'volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e56beff-a102-4e63-b04a-4679f5bd77b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e56beff-a102-4e63-b04a-4679f5bd77b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c2dba-1dea-4ed1-a689-5997fea059d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7', 'volume_size': 1}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (7cd82a85-9199-4872-a80b-ee7947897a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f68cf4-30f8-4d2a-acda-1cf344a2ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f68cf4-30f8-4d2a-acda-1cf344a2ef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337203831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:30Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39764b1-35e9-4781-ad2d-4263c7369f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39764b1-35e9-4781-ad2d-4263c7369f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbb56c3-53a9-40d3-bad6-e62955142ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbb56c3-53a9-40d3-bad6-e62955142ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c', 'volume_name': 'volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042401c-2673-4019-a1c5-771213281318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042401c-2673-4019-a1c5-771213281318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9352d900-9618-44b1-9021-547eace62a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Volume fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c', 'volume_size': 1}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:29 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 1073741824" returned: 0 in 1.125s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:30 devstack sudo[111042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2
Jun 17 04:24:30 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (9e34cfdc-baaf-44c8-8b01-2dfa059c1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe088036-25bd-4965-bc64-7bf45edd34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe088036-25bd-4965-bc64-7bf45edd34bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169669178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f3acc1-de45-4f65-9995-df2bda7d3d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:30Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7b768f-1228-4caf-ab51-36877ccca867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7b768f-1228-4caf-ab51-36877ccca867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c97b5e-94b6-46e4-a86c-522a4e8b1e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c97b5e-94b6-46e4-a86c-522a4e8b1e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f3acc1-de45-4f65-9995-df2bda7d3d3a', 'volume_name': 'volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1427b98-c922-4134-8f45-8529dc4d0b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1427b98-c922-4134-8f45-8529dc4d0b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f65a0b2-3412-4a27-90be-5ac608735c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Volume c9f3acc1-de45-4f65-9995-df2bda7d3d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a', 'volume_size': 1}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (97a481fc-d84b-4cbb-92cc-aa93a0ff4326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787ddeeb-bcd1-4712-96e4-1c4bd315279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787ddeeb-bcd1-4712-96e4-1c4bd315279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783148568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ad0643-60d5-4936-9e53-850ddd9ff0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:31Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae32e1e7-64d0-4d4b-85fc-9c27c149bae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae32e1e7-64d0-4d4b-85fc-9c27c149bae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87443598-1af6-4743-926a-59461dedd9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87443598-1af6-4743-926a-59461dedd9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ad0643-60d5-4936-9e53-850ddd9ff0f5', 'volume_name': 'volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c408fc4-632c-4cc5-86fa-3c9c133f3ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c408fc4-632c-4cc5-86fa-3c9c133f3ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accd53ab-7afc-403f-aaff-4790228f3fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Volume f0ad0643-60d5-4936-9e53-850ddd9ff0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5', 'volume_size': 1}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" returned: 0 in 0.727s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a740490-105f-4d28-b00f-94dd1e580329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718913f9c7804aebb697d14bf07eb011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='25f780fec3dd48d2bc38382a36a70d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Creating volume 4a740490-105f-4d28-b00f-94dd1e580329 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:30 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:30 devstack sudo[111045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 1073741824
Jun 17 04:24:30 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfac255-4b7c-4889-ad55-2ef942907b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97154727-8994-44d6-b031-1d07412398d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:30 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Volume volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 (d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2): created successfully
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97154727-8994-44d6-b031-1d07412398d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:30 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (6a6bdf3f-e65d-4a94-b860-abb01367079e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:30 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1cce8292-72ca-4152-ab91-baed4f5c9a66 tempest-CreateVolumesFromImageTest-334398377 None] Created volume successfully.
Jun 17 04:24:31 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 1073741824" returned: 0 in 0.844s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:31 devstack sudo[111051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329
Jun 17 04:24:31 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:32 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329" returned: 0 in 0.637s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728513067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671a4e42-92e7-4aeb-b375-ee3862ccbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Creating volume 671a4e42-92e7-4aeb-b375-ee3862ccbb84 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:32 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:32 devstack sudo[111054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 1073741824
Jun 17 04:24:32 devstack sudo[111054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f551b2-b514-4b33-93ca-7ee8088f5403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a740490-105f-4d28-b00f-94dd1e580329', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7c4af7-8990-4566-9ceb-496c94403509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Volume volume-4a740490-105f-4d28-b00f-94dd1e580329 (4a740490-105f-4d28-b00f-94dd1e580329): created successfully
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7c4af7-8990-4566-9ceb-496c94403509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Flow 'volume_create_manager' (904e0f59-d1a1-4730-829a-169447ee2866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:32 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-93412dc5-059f-4d20-852c-7bd2d59f1e00 tempest-CinderUnicodeTest-1319514259 None] Created volume successfully.
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Flow 'volume_create_manager' (8376bd55-55df-4313-b017-bf84b1063e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1671c33-d784-4d40-8fb4-cdece5be0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1671c33-d784-4d40-8fb4-cdece5be0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c269b3-2b1b-4e35-bec1-75ba0c7ceac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3aca45c13c7470194ab4f7ec60bfb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:32Z,use_quota=True,user_id='7ce76c12e4524aac92966c4139484098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae67b19-da12-480f-b526-1d32a526ed12),volume_type_id=3ae67b19-da12-480f-b526-1d32a526ed12)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b35b637-e7c1-464a-bc93-4deb69e1c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b35b637-e7c1-464a-bc93-4deb69e1c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde8ad47-02d4-4866-a3b9-94f2b9504d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde8ad47-02d4-4866-a3b9-94f2b9504d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57c269b3-2b1b-4e35-bec1-75ba0c7ceac4', 'volume_name': 'volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4', 'volume_size': 1, 'image_id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bfc97fe1eca9db042b0c12ca9b22b1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3aca45c13c7470194ab4f7ec60bfb88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6ac8ab918014c0e7ffa5bb9ce5ad69298cf89341a861a2eedfa8e6182f59940ca75896a12c45f75e77d522e159cec20fd171c34a382a3add9308f619edb33ff', 'id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'created_at': datetime.datetime(2026, 6, 17, 2, 24, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 24, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d116b646-4a1a-438a-921b-5f79e01e6a19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4bf1c0b0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de539ffd-b7af-4970-a098-cbf75918f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de539ffd-b7af-4970-a098-cbf75918f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699b5e01-501b-47f4-be88-2a729440934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:32 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4', 'volume_size': 1, 'image_id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bfc97fe1eca9db042b0c12ca9b22b1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3aca45c13c7470194ab4f7ec60bfb88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6ac8ab918014c0e7ffa5bb9ce5ad69298cf89341a861a2eedfa8e6182f59940ca75896a12c45f75e77d522e159cec20fd171c34a382a3add9308f619edb33ff', 'id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'created_at': datetime.datetime(2026, 6, 17, 2, 24, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 24, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d116b646-4a1a-438a-921b-5f79e01e6a19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4bf1c0b0>}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Trying to clone 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 from image d116b646-4a1a-438a-921b-5f79e01e6a19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:24:32 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Image download 0.00 MB at 0.00 MB/s
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a83e6b-0a76-43b6-b61a-a9683a8d9171]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:33 devstack sudo[111059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:33 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:33 devstack sudo[111054]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 1073741824" returned: 0 in 0.909s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:33 devstack sudo[111061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84
Jun 17 04:24:33 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:33 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:33 devstack sudo[111072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:33 devstack sudo[111072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:33 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84" returned: 0 in 0.660s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.359s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1928099950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:29Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:33 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:33 devstack sudo[111074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 1073741824
Jun 17 04:24:33 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a98532-5f4b-478d-850f-15ab3f1b7db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10bc23f-b116-4399-a99b-6747baab2551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:33 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Volume volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 (671a4e42-92e7-4aeb-b375-ee3862ccbb84): created successfully
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10bc23f-b116-4399-a99b-6747baab2551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (63971f2a-cd43-4ab1-92d1-abb29ad33bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Flow 'volume_create_manager' (6162617d-a42c-41a2-b463-2ecf5f11c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:33 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e1c6a9-a410-43db-b385-5df6d59cbe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d77cc2af-b5c4-44b4-9491-928e51c93069 tempest-CreateVolumesFromImageTest-334398377 None] Created volume successfully.
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e1c6a9-a410-43db-b385-5df6d59cbe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1977582462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701e5790-0554-4274-9154-81ffda803084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718913f9c7804aebb697d14bf07eb011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:34Z,use_quota=True,user_id='25f780fec3dd48d2bc38382a36a70d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1f2492-993e-4ea0-91de-7e3cce8cb4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1f2492-993e-4ea0-91de-7e3cce8cb4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f75445-038f-4d04-9eb8-f70632160f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f75445-038f-4d04-9eb8-f70632160f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701e5790-0554-4274-9154-81ffda803084', 'volume_name': 'volume-701e5790-0554-4274-9154-81ffda803084', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8976a203-0bd1-4b61-afb4-b85d2cce8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8976a203-0bd1-4b61-afb4-b85d2cce8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531376ea-2d77-402c-8549-f32fe7fcc883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:34 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Volume 701e5790-0554-4274-9154-81ffda803084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701e5790-0554-4274-9154-81ffda803084', 'volume_size': 1}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:34 devstack sudo[111072]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 1 in 0.745s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Temporary image d116b646-4a1a-438a-921b-5f79e01e6a19 is fetched for user 7ce76c12e4524aac92966c4139484098. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[af233d81-6173-4807-98af-ba86ad6d65ee]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:34 devstack sudo[111083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:34 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:34 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 1073741824" returned: 0 in 0.778s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:34 devstack sudo[111085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7
Jun 17 04:24:34 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:35 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:35 devstack sudo[111089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:35 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:35 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" returned: 0 in 0.658s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337203831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:30Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Creating volume fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:35 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c2dba-1dea-4ed1-a689-5997fea059d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd852a1b-6bf5-48d7-9bcd-9f3dbdc96fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:35 devstack sudo[111092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c 1073741824
Jun 17 04:24:35 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:35 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 (d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7): created successfully
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd852a1b-6bf5-48d7-9bcd-9f3dbdc96fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (3e217437-430a-444e-af5f-8870c16f9e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:35 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7e9c6358-f7a7-4a9f-a3c7-f23171e83c9f tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:35 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 1 in 0.677s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (4d56dfa4-e4cc-42b0-8a0c-f357bd48648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89595095-9dc1-4ebb-b591-9d805aa5b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89595095-9dc1-4ebb-b591-9d805aa5b045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827680343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b0080f-7c4e-418a-a1ab-5709f43ca107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:36Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9051433a-d644-4051-a53a-748bb51c44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9051433a-d644-4051-a53a-748bb51c44ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec6363-87cb-4b93-be00-2dfacc94b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec6363-87cb-4b93-be00-2dfacc94b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b0080f-7c4e-418a-a1ab-5709f43ca107', 'volume_name': 'volume-61b0080f-7c4e-418a-a1ab-5709f43ca107', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b9c7d2-4929-4f7a-b4f0-0291c20d6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b9c7d2-4929-4f7a-b4f0-0291c20d6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8247117-4b38-48bf-9d5e-b5f248eab9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume 61b0080f-7c4e-418a-a1ab-5709f43ca107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b0080f-7c4e-418a-a1ab-5709f43ca107', 'volume_size': 1}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:36 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c 1073741824" returned: 0 in 0.896s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:36 devstack sudo[111103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c
Jun 17 04:24:36 devstack sudo[111103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (36cc7a0f-9a68-4d0e-96f2-56152d253bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cccc18b-1267-4fb1-a04d-fd2c55baa9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cccc18b-1267-4fb1-a04d-fd2c55baa9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561533967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34927532-d18d-49a4-bdc8-00675e391b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:36Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd03ed45-4d45-4ec1-8958-fd0cf8a0edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd03ed45-4d45-4ec1-8958-fd0cf8a0edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be9520-01f2-4877-8c18-2f355f3ca1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be9520-01f2-4877-8c18-2f355f3ca1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34927532-d18d-49a4-bdc8-00675e391b15', 'volume_name': 'volume-34927532-d18d-49a4-bdc8-00675e391b15', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421fa2cd-5d9d-4d05-a08a-fbc92a8510ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421fa2cd-5d9d-4d05-a08a-fbc92a8510ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a8d600-d793-49b6-ba71-c8471cc93a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume 34927532-d18d-49a4-bdc8-00675e391b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34927532-d18d-49a4-bdc8-00675e391b15', 'volume_size': 1}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (c2a8694f-de72-4240-a7cb-7420847da45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc46cd7-5aba-4fce-a2ac-698d1645f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc46cd7-5aba-4fce-a2ac-698d1645f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964150186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6e1dd0-a403-4f3b-a3e9-830c133cba50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:37Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eb216a-54c2-4fc1-b571-ade33a32825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eb216a-54c2-4fc1-b571-ade33a32825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2829de-8307-40ab-b63d-2ab814a01614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2829de-8307-40ab-b63d-2ab814a01614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6e1dd0-a403-4f3b-a3e9-830c133cba50', 'volume_name': 'volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack sudo[111103]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9502cc11-19f9-468d-9068-fc5a351ff16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9502cc11-19f9-468d-9068-fc5a351ff16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ecb7b4-d75a-4fbf-af90-57b3cfbdaba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:36 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume ee6e1dd0-a403-4f3b-a3e9-830c133cba50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50', 'volume_size': 1}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" returned: 0 in 0.693s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.599s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169669178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f3acc1-de45-4f65-9995-df2bda7d3d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:30Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Creating volume c9f3acc1-de45-4f65-9995-df2bda7d3d3a {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:37 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9352d900-9618-44b1-9021-547eace62a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64c335b-5185-47ca-86c4-b83ce0a1c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack sudo[111106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a 1073741824
Jun 17 04:24:37 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Volume volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c (fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c): created successfully
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64c335b-5185-47ca-86c4-b83ce0a1c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (7cd82a85-9199-4872-a80b-ee7947897a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:37 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f73f2660-63e2-4bec-9ec5-ebcb1ebab18f tempest-CreateVolumesFromImageTest-334398377 None] Created volume successfully.
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (698b533b-e05e-471a-8803-4e3b10100b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d3cfac-7ba7-42f7-b684-2fa8a781d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d3cfac-7ba7-42f7-b684-2fa8a781d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405351105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0c660-3e46-4531-a643-c79e936d6205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:37Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f343fd9-855d-4340-a491-da83715a1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f343fd9-855d-4340-a491-da83715a1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356efb6c-81f9-48fc-9957-16c4cd02b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356efb6c-81f9-48fc-9957-16c4cd02b966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa0c660-3e46-4531-a643-c79e936d6205', 'volume_name': 'volume-2aa0c660-3e46-4531-a643-c79e936d6205', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67700d05-5371-4690-a2d4-385505ec0d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67700d05-5371-4690-a2d4-385505ec0d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594ffc4-b800-437e-8a1d-d248a4993eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume 2aa0c660-3e46-4531-a643-c79e936d6205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa0c660-3e46-4531-a643-c79e936d6205', 'volume_size': 1}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (5ed9a3e7-d8a4-455d-80f9-75fffb68fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18b1974-beb5-4dec-89d5-c693a6db20a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18b1974-beb5-4dec-89d5-c693a6db20a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345152048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74794ff2-d42a-43d6-8677-91f0d9de950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:38Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbec4c2-4e02-4399-95e4-3ce3de06904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbec4c2-4e02-4399-95e4-3ce3de06904a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e57717-6e37-471f-8d33-b3997f18ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e57717-6e37-471f-8d33-b3997f18ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74794ff2-d42a-43d6-8677-91f0d9de950f', 'volume_name': 'volume-74794ff2-d42a-43d6-8677-91f0d9de950f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db1b313-65cc-47e2-b89e-3ef6be77f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db1b313-65cc-47e2-b89e-3ef6be77f89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1cace2-9d48-4a82-9edc-74b0da5b2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume 74794ff2-d42a-43d6-8677-91f0d9de950f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74794ff2-d42a-43d6-8677-91f0d9de950f', 'volume_size': 1}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:37 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a 1073741824" returned: 0 in 0.890s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:37 devstack sudo[111111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a
Jun 17 04:24:37 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:38 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" returned: 0 in 0.624s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.855s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783148568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ad0643-60d5-4936-9e53-850ddd9ff0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a414dc13b16488baebfbe84e9def643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:31Z,use_quota=True,user_id='91cd07fdd86244208de3b8bfc7c7c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Creating volume f0ad0643-60d5-4936-9e53-850ddd9ff0f5 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:38 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f65a0b2-3412-4a27-90be-5ac608735c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:38 devstack sudo[111114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 1073741824
Jun 17 04:24:38 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b19e59c-333d-4db4-b104-0c331d0a9a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:38 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Volume volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a (c9f3acc1-de45-4f65-9995-df2bda7d3d3a): created successfully
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b19e59c-333d-4db4-b104-0c331d0a9a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:38 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (9e34cfdc-baaf-44c8-8b01-2dfa059c1981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-09f6eaa5-3264-4c3e-a622-57d43df7b2be tempest-CreateVolumesFromImageTest-334398377 None] Created volume successfully.
Jun 17 04:24:39 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 1073741824" returned: 0 in 0.742s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:39 devstack sudo[111120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5
Jun 17 04:24:39 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:39 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" returned: 0 in 0.597s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.898s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1977582462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701e5790-0554-4274-9154-81ffda803084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718913f9c7804aebb697d14bf07eb011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:34Z,use_quota=True,user_id='25f780fec3dd48d2bc38382a36a70d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Creating volume 701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:39 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accd53ab-7afc-403f-aaff-4790228f3fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:39 devstack sudo[111123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 1073741824
Jun 17 04:24:39 devstack sudo[111123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb6a40b-a172-4459-a5fe-a2066effc058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:39 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Volume volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 (f0ad0643-60d5-4936-9e53-850ddd9ff0f5): created successfully
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb6a40b-a172-4459-a5fe-a2066effc058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Flow 'volume_create_manager' (97a481fc-d84b-4cbb-92cc-aa93a0ff4326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:40 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-6539a7c6-c77f-417d-9352-ba2c524db334 tempest-CreateVolumesFromImageTest-334398377 None] Created volume successfully.
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-f0ad0643-60d5-4936-9e53-850ddd9ff0f5-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-f0ad0643-60d5-4936-9e53-850ddd9ff0f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-quobyte-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36a010b-6c89-42ba-9192-b15610fef1aa]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:40 devstack sudo[111128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5
Jun 17 04:24:40 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:40 devstack sudo[111123]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 1073741824" returned: 0 in 0.855s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:40 devstack sudo[111131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084
Jun 17 04:24:40 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:41 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:41 devstack sudo[111138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5
Jun 17 04:24:41 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:41 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084" returned: 0 in 0.632s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.590s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c269b3-2b1b-4e35-bec1-75ba0c7ceac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3aca45c13c7470194ab4f7ec60bfb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:32Z,use_quota=True,user_id='7ce76c12e4524aac92966c4139484098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae67b19-da12-480f-b526-1d32a526ed12),volume_type_id=3ae67b19-da12-480f-b526-1d32a526ed12)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Creating volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:41 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:41 devstack sudo[111140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1073741824
Jun 17 04:24:41 devstack sudo[111140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531376ea-2d77-402c-8549-f32fe7fcc883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701e5790-0554-4274-9154-81ffda803084', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf38739-fece-43ed-b4d9-08dd34d1d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:41 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Volume volume-701e5790-0554-4274-9154-81ffda803084 (701e5790-0554-4274-9154-81ffda803084): created successfully
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf38739-fece-43ed-b4d9-08dd34d1d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:41 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Flow 'volume_create_manager' (6162617d-a42c-41a2-b463-2ecf5f11c416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:41 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5b2c8202-e082-4ebd-9732-6d0534922d15 tempest-CinderUnicodeTest-1319514259 None] Created volume successfully.
Jun 17 04:24:42 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-f0ad0643-60d5-4936-9e53-850ddd9ff0f5" released by "delete_volume" :: held 1.426s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Created reservations ['d71f9406-2ca8-40d3-87fd-3cb9b238db01', '08b1511c-45ce-49e3-8884-cca879285569', '089a1b6c-89fc-4622-83b9-cc7dfa1477a7', 'fb8066ad-8b84-4ba0-962b-a887a8ef14ea'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:42 devstack sudo[111146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:42 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:42 devstack sudo[111140]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1073741824" returned: 0 in 0.788s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:42 devstack sudo[111149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:42 devstack sudo[111149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:42 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.620s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Deleted volume successfully.
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-c9f3acc1-de45-4f65-9995-df2bda7d3d3a-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bdbb5393-3351-4770-8d70-83c384eaa0bc tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-f0ad0643-60d5-4936-9e53-850ddd9ff0f5-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-c9f3acc1-de45-4f65-9995-df2bda7d3d3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-quobyte-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cfd8fd-dce3-4a4e-bbe9-04f7b93e3836]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:42 devstack sudo[111149]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 0 in 0.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.738s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827680343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b0080f-7c4e-418a-a1ab-5709f43ca107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:36Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume 61b0080f-7c4e-418a-a1ab-5709f43ca107 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:43 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:43 devstack sudo[111153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a
Jun 17 04:24:43 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:43 devstack sudo[111155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 1073741824
Jun 17 04:24:43 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Attempting download of d116b646-4a1a-438a-921b-5f79e01e6a19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}])) to volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea360835-c0ea-4e2a-9bf9-4264058f7454]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:43 devstack sudo[111157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw
Jun 17 04:24:43 devstack sudo[111157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:43 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:43 devstack sudo[111165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a
Jun 17 04:24:43 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:43 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 1073741824" returned: 0 in 0.784s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:43 devstack sudo[111157]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw" returned: 0 in 0.721s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:43 devstack sudo[111170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107
Jun 17 04:24:43 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:43 devstack sudo[111169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw
Jun 17 04:24:43 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:44 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" returned: 0 in 0.579s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-c9f3acc1-de45-4f65-9995-df2bda7d3d3a" released by "delete_volume" :: held 1.361s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Created reservations ['0ac0e4cb-2924-427d-91fb-9dbbfc3f3710', '0c8df826-c30f-4527-9760-56623048a081', '1928a141-c1b6-4323-a402-a14015d1493d', '8e143fae-88fc-4d94-a68b-602afa4ac91f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:44 devstack sudo[111174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:44 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:44 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.823s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561533967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34927532-d18d-49a4-bdc8-00675e391b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:36Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume 34927532-d18d-49a4-bdc8-00675e391b15 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:44 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:44 devstack sudo[111177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 1073741824
Jun 17 04:24:44 devstack sudo[111177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8247117-4b38-48bf-9d5e-b5f248eab9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b0080f-7c4e-418a-a1ab-5709f43ca107', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717913ac-9925-4657-aca8-11568d9a9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:44 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 (61b0080f-7c4e-418a-a1ab-5709f43ca107): created successfully
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717913ac-9925-4657-aca8-11568d9a9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (4d56dfa4-e4cc-42b0-8a0c-f357bd48648d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d09b7da6-7307-440a-bbea-83252487bc2e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:44 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw" returned: 1 in 0.781s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d116b646-4a1a-438a-921b-5f79e01e6a19_knx7lhgw' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f70ccc1-5709-4123-ad2d-036121d05f83]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:44 devstack sudo[111181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:44 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:45 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:45 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Deleted volume successfully.
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8b95245e-2fac-4f6f-9283-570ab0d33191 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-c9f3acc1-de45-4f65-9995-df2bda7d3d3a-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-quobyte-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbae9a0-868d-4a9d-a516-e6f3be21e6b7]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:45 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:45 devstack sudo[111188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c
Jun 17 04:24:45 devstack sudo[111188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:45 devstack sudo[111177]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 1073741824" returned: 0 in 0.902s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:45 devstack sudo[111193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15
Jun 17 04:24:45 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:45 devstack sudo[111191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD
Jun 17 04:24:45 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:45 devstack sudo[111188]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" returned: 0 in 0.733s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:45 devstack sudo[111203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c
Jun 17 04:24:45 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:46 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15" returned: 0 in 0.593s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.016s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:46 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964150186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6e1dd0-a403-4f3b-a3e9-830c133cba50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:37Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume ee6e1dd0-a403-4f3b-a3e9-830c133cba50 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:46 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD" returned: 1 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] d116b646-4a1a-438a-921b-5f79e01e6a19 was raw, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:46 devstack sudo[111205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 1073741824
Jun 17 04:24:46 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a8d600-d793-49b6-ba71-c8471cc93a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34927532-d18d-49a4-bdc8-00675e391b15', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f253bde-7351-438a-85b6-d68896826e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:46 devstack sudo[111207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:46 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:46 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-34927532-d18d-49a4-bdc8-00675e391b15 (34927532-d18d-49a4-bdc8-00675e391b15): created successfully
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f253bde-7351-438a-85b6-d68896826e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (36cc7a0f-9a68-4d0e-96f2-56152d253bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8474a72d-8d49-4029-9cba-40d1eb960aa6 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:46 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" returned: 0 in 0.616s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c" released by "delete_volume" :: held 1.399s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Created reservations ['b24ef32f-2b8f-48e1-a241-a59fa96116e6', '797a6763-501e-4447-8b67-24607129c2ba', 'fc6f6063-8555-4428-9847-0b7e365f8c35', '53cc0b96-69f9-42bd-989c-926b368c0400'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:46 devstack sudo[111217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:46 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:46 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 0 in 0.773s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d116b646-4a1a-438a-921b-5f79e01e6a19_xkq3o4wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:24:46 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Converted 0.00 MB image at 0.00 MB/s
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:46 devstack sudo[111220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1G
Jun 17 04:24:46 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:46 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 1073741824" returned: 0 in 0.910s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:46 devstack sudo[111222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50
Jun 17 04:24:46 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:47 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.647s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Deleted volume successfully.
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8fb03c9a-0fc4-4170-90f5-be318f7e67d2 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-fe5fdfd2-5be5-4fe9-baa6-b7dca2646f7c-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-671a4e42-92e7-4aeb-b375-ee3862ccbb84-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-671a4e42-92e7-4aeb-b375-ee3862ccbb84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-quobyte-671a4e42-92e7-4aeb-b375-ee3862ccbb84" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-671a4e42-92e7-4aeb-b375-ee3862ccbb84" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c4654-9256-45fd-a4a8-3094f58096c4]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:47 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 1G" returned: 0 in 0.728s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:47 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" returned: 0 in 0.613s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.222s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405351105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0c660-3e46-4531-a643-c79e936d6205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:37Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume 2aa0c660-3e46-4531-a643-c79e936d6205 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:47 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f89b88-4c2e-4235-8c0e-c17b08c6eecb]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:47 devstack sudo[111230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 1073741824
Jun 17 04:24:47 devstack sudo[111230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ecb7b4-d75a-4fbf-af90-57b3cfbdaba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a072a3-4fc0-4aa5-b312-32ebcf4b3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:47 devstack sudo[111229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84
Jun 17 04:24:47 devstack sudo[111229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:47 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 (ee6e1dd0-a403-4f3b-a3e9-830c133cba50): created successfully
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a072a3-4fc0-4aa5-b312-32ebcf4b3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:47 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (c2a8694f-de72-4240-a7cb-7420847da45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:47 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4ba9ca5b-2ad2-4a01-834e-89348e3bffc9 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:47 devstack sudo[111231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:47 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:48 devstack sudo[111229]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84" returned: 0 in 0.719s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:48 devstack sudo[111244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84
Jun 17 04:24:48 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:48 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 0 in 0.705s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:48 devstack sudo[111230]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 1073741824" returned: 0 in 0.836s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:48 devstack sudo[111246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:48 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:48 devstack sudo[111248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205
Jun 17 04:24:48 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:48 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-671a4e42-92e7-4aeb-b375-ee3862ccbb84" returned: 0 in 0.633s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-671a4e42-92e7-4aeb-b375-ee3862ccbb84" released by "delete_volume" :: held 1.402s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:48 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Created reservations ['82e49a45-8f0c-49ee-b111-499bf144e3ab', '0a9420b8-a33b-45e5-98a3-25a0832484a6', '4825fd7f-b988-42a4-be5e-e30a49e01073', 'de7a540d-425b-4640-8f50-672332a409e4'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:49 devstack sudo[111255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:49 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:49 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 1 in 0.760s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Downloaded image d116b646-4a1a-438a-921b-5f79e01e6a19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}])) to volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Temporary image d116b646-4a1a-438a-921b-5f79e01e6a19 for user 7ce76c12e4524aac92966c4139484098 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Marking volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Copying metadata from image d116b646-4a1a-438a-921b-5f79e01e6a19 to 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Creating volume glance metadata for volume 57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 backed by image d116b646-4a1a-438a-921b-5f79e01e6a19 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7bfc97fe1eca9db042b0c12ca9b22b1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:24:49 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205" returned: 0 in 0.653s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.457s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345152048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74794ff2-d42a-43d6-8677-91f0d9de950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c4895b5554cdea093d46398d04c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:38Z,use_quota=True,user_id='a3dfe6c1284e4af680195e91574f33f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Creating volume 74794ff2-d42a-43d6-8677-91f0d9de950f {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:49 devstack sudo[111257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f 1073741824
Jun 17 04:24:49 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594ffc4-b800-437e-8a1d-d248a4993eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa0c660-3e46-4531-a643-c79e936d6205', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cbe6b8-360d-4f37-9b13-b9b5f824f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-2aa0c660-3e46-4531-a643-c79e936d6205 (2aa0c660-3e46-4531-a643-c79e936d6205): created successfully
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cbe6b8-360d-4f37-9b13-b9b5f824f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (698b533b-e05e-471a-8803-4e3b10100b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699b5e01-501b-47f4-be88-2a729440934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4', 'volume_size': 1, 'image_id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d116b646-4a1a-438a-921b-5f79e01e6a19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bfc97fe1eca9db042b0c12ca9b22b1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3aca45c13c7470194ab4f7ec60bfb88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6ac8ab918014c0e7ffa5bb9ce5ad69298cf89341a861a2eedfa8e6182f59940ca75896a12c45f75e77d522e159cec20fd171c34a382a3add9308f619edb33ff', 'id': 'd116b646-4a1a-438a-921b-5f79e01e6a19', 'created_at': datetime.datetime(2026, 6, 17, 2, 24, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 24, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d116b646-4a1a-438a-921b-5f79e01e6a19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4bf1c0b0>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ae7dd-056e-49bc-a65a-408535b9ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b2d79599-93f7-4d2b-a3d9-29b8ee58144e tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Volume volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 (57c269b3-2b1b-4e35-bec1-75ba0c7ceac4): created successfully
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ae7dd-056e-49bc-a65a-408535b9ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Flow 'volume_create_manager' (8376bd55-55df-4313-b017-bf84b1063e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-880dc72d-2e27-4ab6-a0e1-119f5cd6e013 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Created volume successfully.
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Acquiring lock "cinder-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "cinder-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Acquiring lock "cinder-quobyte-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "cinder-quobyte-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" acquired by "delete_volume" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:49 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.668s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:49 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Deleted volume successfully.
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eb6792-95a9-4cdf-b149-eb9d45d2910a]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-b91912c0-f3c5-454f-9cc8-f8a90b5b5a2e tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-671a4e42-92e7-4aeb-b375-ee3862ccbb84-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "cinder-quobyte-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" acquired by "delete_volume" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ce200-0104-4f75-b7bd-d89893c3f4f2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:49 devstack sudo[111263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:49 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:49 devstack sudo[111265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2
Jun 17 04:24:49 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:49 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:49 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f 1073741824" returned: 0 in 0.854s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:50 devstack sudo[111268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f
Jun 17 04:24:50 devstack sudo[111268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:50 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 0 in 0.756s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:50 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" returned: 0 in 0.712s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:50 devstack sudo[111277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2
Jun 17 04:24:50 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:50 devstack sudo[111268]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:50 devstack sudo[111275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:50 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.927s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1cace2-9d48-4a82-9edc-74b0da5b2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74794ff2-d42a-43d6-8677-91f0d9de950f', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acff47f-71f3-4754-a78f-da9f297070d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Creating offline snapshot f43cf2e0-1887-4aec-bfa7-84c4191ded52 of volume 701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:24:50 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Volume volume-74794ff2-d42a-43d6-8677-91f0d9de950f (74794ff2-d42a-43d6-8677-91f0d9de950f): created successfully
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acff47f-71f3-4754-a78f-da9f297070d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Flow 'volume_create_manager' (5ed9a3e7-d8a4-455d-80f9-75fffb68fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[17549805-bd05-4059-943f-5d8c6a5a8df9]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:50 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9ab8ce8a-2bdd-49e0-b2e7-1c2a9a7d650a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created volume successfully.
Jun 17 04:24:50 devstack sudo[111280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084
Jun 17 04:24:50 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-74794ff2-d42a-43d6-8677-91f0d9de950f-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-74794ff2-d42a-43d6-8677-91f0d9de950f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-74794ff2-d42a-43d6-8677-91f0d9de950f" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-74794ff2-d42a-43d6-8677-91f0d9de950f" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26a82b-1498-43ec-9835-1591834f9a06]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:51 devstack sudo[111282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f
Jun 17 04:24:51 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:51 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" returned: 0 in 0.703s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-quobyte-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2" released by "delete_volume" :: held 1.459s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Created reservations ['659d7856-6974-4f35-8efd-c422b588c653', '8fbf5d5d-7df0-4290-b7f5-51502574abe7', 'd00efbdd-74b7-4718-bd9c-fb1369686942', 'e9c548e0-4eee-467a-87fb-11bf7a03ef34'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:51 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 1 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:51 devstack sudo[111288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4
Jun 17 04:24:51 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:51 devstack sudo[111293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:51 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:51 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084" returned: 0 in 0.822s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:51 devstack sudo[111295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 1G
Jun 17 04:24:51 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:51 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f" returned: 0 in 0.812s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:51 devstack sudo[111301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f
Jun 17 04:24:51 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:52 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "cinder-quobyte-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4" released by "delete_volume" :: held 2.377s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Created reservations ['c13059fa-abeb-47a8-9e7b-8ef4eb8541a3', '9d30debe-f813-4597-afc7-3e1714671f59', 'c1adbc57-a38d-456c-9970-483215aaad8f', 'a2128f73-7ea0-42a2-951d-e8170760901d'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:52 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.832s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:52 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Deleted volume successfully.
Jun 17 04:24:52 devstack sudo[111342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:52 devstack sudo[111342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-ef19ace1-841a-46e3-b5a8-2f66ab0b94c0 tempest-CreateVolumesFromImageTest-334398377 None] Lock "cinder-d6fb83fb-796b-4ccf-8fb4-6d8f775a2ac2-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:52 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 1G" returned: 0 in 1.022s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701e5790-0554-4274-9154-81ffda803084 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:52 devstack sudo[111345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701e5790-0554-4274-9154-81ffda803084 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52
Jun 17 04:24:52 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:52 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-74794ff2-d42a-43d6-8677-91f0d9de950f" returned: 0 in 0.815s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-74794ff2-d42a-43d6-8677-91f0d9de950f" released by "delete_volume" :: held 1.694s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['cdc84a02-882f-42ca-96a9-1392f8da98b6', '31020e17-6b93-4947-9fcf-c489e332f7f3', '7351b773-6de7-4653-aa7a-7aeae52191eb', '5f2c99ed-cf48-44b0-96cc-8d7454c6411e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:52 devstack sudo[111350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:52 devstack sudo[111350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:53 devstack sudo[111342]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.950s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:53 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Deleted volume successfully.
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-2aa0c660-3e46-4531-a643-c79e936d6205-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-2aa0c660-3e46-4531-a643-c79e936d6205-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2372dcac-e52d-4e45-846b-f85a439dd955 tempest-VolumeAndVolumeTypeFromImageTest-1333654739 None] Lock "cinder-57c269b3-2b1b-4e35-bec1-75ba0c7ceac4-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-2aa0c660-3e46-4531-a643-c79e936d6205" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-2aa0c660-3e46-4531-a643-c79e936d6205" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ffee6-bdd8-4ea7-a1d1-b81db414f5d4]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:53 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701e5790-0554-4274-9154-81ffda803084 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52" returned: 0 in 0.982s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:53 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 is being set with open permissions: ugo+rw
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:53 devstack sudo[111357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52
Jun 17 04:24:53 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:53 devstack sudo[111356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205
Jun 17 04:24:53 devstack sudo[111356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:53 devstack sudo[111350]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.888s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:53 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:24:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-964e46ca-184f-436d-9b7f-0a469a44f594 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-74794ff2-d42a-43d6-8677-91f0d9de950f-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:54 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52" returned: 0 in 0.850s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:54 devstack sudo[111356]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205" returned: 0 in 0.994s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:54 devstack sudo[111366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info
Jun 17 04:24:54 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:54 devstack sudo[111368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205
Jun 17 04:24:54 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:55 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info" returned: 0 in 0.811s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:55 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info is being set with open permissions: ugo+rw
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:55 devstack sudo[111373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info
Jun 17 04:24:55 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:55 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-2aa0c660-3e46-4531-a643-c79e936d6205" returned: 0 in 0.858s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-2aa0c660-3e46-4531-a643-c79e936d6205" released by "delete_volume" :: held 1.929s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['d5bc2066-293b-4ca2-adbc-861f1409b6f3', 'bc19d314-deb5-417b-9011-4be81c734b39', '47a83887-0ca7-4c5f-b27a-656b789e8472', '87635bfd-dd1c-4255-94c6-a00d5944a920'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:55 devstack sudo[111375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:55 devstack sudo[111375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-ee6e1dd0-a403-4f3b-a3e9-830c133cba50-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-ee6e1dd0-a403-4f3b-a3e9-830c133cba50-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" acquired by "delete_volume" :: waited 0.045s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a574f53f-f81c-4a43-97a8-88cf77f68b14]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:55 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.info" returned: 0 in 0.752s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:56 devstack sudo[111378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50
Jun 17 04:24:56 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:56 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-67ec81c1-aba6-452b-bc5c-0eec24f3ec0c tempest-CinderUnicodeTest-1319514259 None] Create snapshot completed successfully
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-f43cf2e0-1887-4aec-bfa7-84c4191ded52-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:56 devstack sudo[111375]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Flow 'volume_create_manager' (074c045e-f95d-4b2d-be57-6b2f4d88c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900c13dd-0996-4ff2-9fd9-dab2beae58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.003s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-f43cf2e0-1887-4aec-bfa7-84c4191ded52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:56 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900c13dd-0996-4ff2-9fd9-dab2beae58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1648510349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b79820b-9754-438b-8aac-5917b683af76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa659b4c08a45c4a1b41077fa83e0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:56Z,use_quota=True,user_id='a63b36e5369d4bdd9a1844ca55bb7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0be7e3-d1f8-429a-95fb-f8765cfadd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0be7e3-d1f8-429a-95fb-f8765cfadd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd42df-9792-4353-8183-f2492e884aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd42df-9792-4353-8183-f2492e884aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b79820b-9754-438b-8aac-5917b683af76', 'volume_name': 'volume-0b79820b-9754-438b-8aac-5917b683af76', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b440d826-2170-48fa-a86a-a36e131ece3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b440d826-2170-48fa-a86a-a36e131ece3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd947654-683d-4c6d-87e0-d31e101b1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:56 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Volume 0b79820b-9754-438b-8aac-5917b683af76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b79820b-9754-438b-8aac-5917b683af76', 'volume_size': 1}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1648510349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b79820b-9754-438b-8aac-5917b683af76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa659b4c08a45c4a1b41077fa83e0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:56Z,use_quota=True,user_id='a63b36e5369d4bdd9a1844ca55bb7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Creating volume 0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:24:56 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" acquired by "delete_snapshot" :: waited 0.089s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-quobyte-f43cf2e0-1887-4aec-bfa7-84c4191ded52" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5c2fb81c-b106-4941-9da5-dba66f9e3e24 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-2aa0c660-3e46-4531-a643-c79e936d6205-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:56 devstack sudo[111382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 1073741824
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-f43cf2e0-1887-4aec-bfa7-84c4191ded52" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:56 devstack sudo[111382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Deleting offline snapshot f43cf2e0-1887-4aec-bfa7-84c4191ded52 of volume 701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] snapshot_file for this snap is: volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa623cd-7c3e-4968-88bd-b11e86189df3]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:56 devstack sudo[111384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52
Jun 17 04:24:56 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:56 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" returned: 0 in 1.070s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:56 devstack sudo[111389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50
Jun 17 04:24:56 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:57 devstack sudo[111382]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 1073741824" returned: 0 in 0.936s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:57 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52" returned: 0 in 0.892s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701e5790-0554-4274-9154-81ffda803084(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa4bff-ab0e-4f16-8ef8-aec3ee090b6a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:57 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" returned: 0 in 0.652s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:57 devstack sudo[111399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:24:57 devstack sudo[111399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-ee6e1dd0-a403-4f3b-a3e9-830c133cba50" released by "delete_volume" :: held 1.801s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['1fd4196b-436d-4cba-8c83-9b23440a0ec4', '84a2fcd2-36b8-47a0-9475-f5fd375ae27a', '63280460-29a3-40a0-a43f-e7bcd590246f', 'ab2caed6-0037-46bd-8127-b0fd8afac7b6'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:24:57 devstack sudo[111400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084
Jun 17 04:24:57 devstack sudo[111400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:57 devstack sudo[111403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:24:57 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-34927532-d18d-49a4-bdc8-00675e391b15-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-34927532-d18d-49a4-bdc8-00675e391b15-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-34927532-d18d-49a4-bdc8-00675e391b15" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-34927532-d18d-49a4-bdc8-00675e391b15" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9fed38-1459-4c2e-b2e5-771cafe283e5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:58 devstack sudo[111399]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 0.783s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:24:58 devstack sudo[111407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15
Jun 17 04:24:58 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd947654-683d-4c6d-87e0-d31e101b1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b79820b-9754-438b-8aac-5917b683af76', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2c5d23-c520-4e73-b6f6-6d5ab632bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:58 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Volume volume-0b79820b-9754-438b-8aac-5917b683af76 (0b79820b-9754-438b-8aac-5917b683af76): created successfully
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2c5d23-c520-4e73-b6f6-6d5ab632bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Flow 'volume_create_manager' (074c045e-f95d-4b2d-be57-6b2f4d88c087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f8adf055-ba10-4bd4-b9f1-da0b2ca243c0 tempest-VolumeDependencyTests-615554410 None] Created volume successfully.
Jun 17 04:24:58 devstack sudo[111400]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084" returned: 0 in 0.998s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:58 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.835s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:24:58 devstack sudo[111414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52
Jun 17 04:24:58 devstack sudo[111414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:58 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-d64a55b0-0764-428e-93f8-c8147bd4303a tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-ee6e1dd0-a403-4f3b-a3e9-830c133cba50-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Creating offline snapshot 41a43af8-ebb0-44b6-be7e-857318a2de39 of volume 0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e7743e-a4b3-4fb5-9a5c-465d268f783d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:24:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:58 devstack sudo[111416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:24:58 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:59 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15" returned: 0 in 1.056s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:59 devstack sudo[111423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15
Jun 17 04:24:59 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (7613bf01-04b2-4197-8d20-ad9d158a2b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137077e-8a23-4df0-99ed-e9df94b785de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137077e-8a23-4df0-99ed-e9df94b785de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816922853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd743f05-254f-4e12-9579-480b792c1b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:59Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595f1e4b-08b6-4ec9-adf9-5ff36000371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595f1e4b-08b6-4ec9-adf9-5ff36000371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9c0148-1f4a-4a07-80e7-bed9be9fd8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9c0148-1f4a-4a07-80e7-bed9be9fd8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd743f05-254f-4e12-9579-480b792c1b3e', 'volume_name': 'volume-bd743f05-254f-4e12-9579-480b792c1b3e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4ebd31-5384-4454-9c61-4767f962533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4ebd31-5384-4454-9c61-4767f962533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc2d484-bf19-4ebc-ad38-5341456218ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:24:59 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume bd743f05-254f-4e12-9579-480b792c1b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd743f05-254f-4e12-9579-480b792c1b3e', 'volume_size': 1}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:24:59 devstack sudo[111414]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52" returned: 0 in 0.865s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:59 devstack sudo[111426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52
Jun 17 04:24:59 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:59 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 0.837s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:24:59 devstack sudo[111431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 1G
Jun 17 04:24:59 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:24:59 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-34927532-d18d-49a4-bdc8-00675e391b15" returned: 0 in 0.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-34927532-d18d-49a4-bdc8-00675e391b15" released by "delete_volume" :: held 1.784s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:24:59 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['d37da61b-9e24-465d-8c60-87d729ea9e20', 'bafaf042-a6c3-4b41-92f0-98e4964e7243', '88fcb0be-d2b5-416c-b1e5-6dfc053624a4', 'ee63db54-e58f-4ca2-899b-efa5e6ddb5a3'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:00 devstack sudo[111435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:00 devstack sudo[111435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:00 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084.f43cf2e0-1887-4aec-bfa7-84c4191ded52" returned: 0 in 0.654s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-f43cf2e0-1887-4aec-bfa7-84c4191ded52" released by "_delete_snapshot" :: held 3.540s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" released by "delete_snapshot" :: held 3.583s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Created reservations ['6c0e9065-31f4-4073-8e77-877f0ca58428', '7535ba05-f16d-4506-9444-e26077d104df', '10d85803-8db4-4d00-bc8d-75676cbb3660', '858262cd-41e3-4777-ac95-d34498c8a196'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Delete snapshot completed successfully.
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-56ae47b3-6d3d-43ce-b048-dfca60947a5a tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-f43cf2e0-1887-4aec-bfa7-84c4191ded52-delete_snapshot" released by "delete_snapshot" :: held 3.815s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-61b0080f-7c4e-418a-a1ab-5709f43ca107-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-61b0080f-7c4e-418a-a1ab-5709f43ca107-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-61b0080f-7c4e-418a-a1ab-5709f43ca107" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-61b0080f-7c4e-418a-a1ab-5709f43ca107" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f30df-670e-41d8-b9fc-08d655175f82]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:00 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 1G" returned: 0 in 0.923s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b79820b-9754-438b-8aac-5917b683af76 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:00 devstack sudo[111624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107
Jun 17 04:25:00 devstack sudo[111624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:00 devstack sudo[111688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b79820b-9754-438b-8aac-5917b683af76 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:00 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:00 devstack sudo[111435]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.736s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:00 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-591f2638-c85f-4748-ba09-f364f3fa26a4 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-34927532-d18d-49a4-bdc8-00675e391b15-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-701e5790-0554-4274-9154-81ffda803084-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:00 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-701e5790-0554-4274-9154-81ffda803084-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae246e-b713-46c2-ab72-89e9d5d4fee8]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:01 devstack sudo[111776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084
Jun 17 04:25:01 devstack sudo[111776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:01 devstack sudo[111624]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107" returned: 0 in 0.802s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:01 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b79820b-9754-438b-8aac-5917b683af76 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.714s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:01 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 is being set with open permissions: ugo+rw
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:01 devstack sudo[111784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107
Jun 17 04:25:01 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:01 devstack sudo[111786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:01 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:01 devstack sudo[111776]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084" returned: 0 in 0.821s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:01 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-61b0080f-7c4e-418a-a1ab-5709f43ca107" returned: 0 in 0.608s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:01 devstack sudo[111796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084
Jun 17 04:25:01 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-61b0080f-7c4e-418a-a1ab-5709f43ca107" released by "delete_volume" :: held 1.456s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:01 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.618s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['e55f3bfe-04b9-4c98-8d3c-efbfae159aff', 'd265fe87-7e8f-4c7f-a2f7-ecee2200b1ed', '7e51362d-c13e-4b71-8df2-2040c71899e8', '2f86ffb9-10dd-4b0b-8319-1ac3fb83311e'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:02 devstack sudo[111798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info
Jun 17 04:25:02 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack sudo[111800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:02 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack sudo[111802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:02 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:02 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-701e5790-0554-4274-9154-81ffda803084" returned: 0 in 0.592s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-701e5790-0554-4274-9154-81ffda803084" released by "delete_volume" :: held 1.485s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Created reservations ['6144fb76-59e9-4d28-b2eb-35038f5f66d8', '08aa05de-5462-499f-b553-f2961f42efaf', 'eb49b106-5c88-4768-b9a0-7ea1151aa726', '4411ae27-d399-4060-8d70-787d871e5e03'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:02 devstack sudo[111806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:02 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info" returned: 0 in 0.687s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:02 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info is being set with open permissions: ugo+rw
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack sudo[111808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info
Jun 17 04:25:02 devstack sudo[111808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "cinder-quobyte-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:02 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.801s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:02 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3f135-586d-42ea-af86-2af397c1d77a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:02 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-999f48ab-9486-402b-a80d-8328da359f6b tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-61b0080f-7c4e-418a-a1ab-5709f43ca107-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:03 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.814s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:25:03 devstack sudo[111812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7
Jun 17 04:25:03 devstack sudo[111812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-4a740490-105f-4d28-b00f-94dd1e580329-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-4a740490-105f-4d28-b00f-94dd1e580329-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "cinder-quobyte-4a740490-105f-4d28-b00f-94dd1e580329" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-4a740490-105f-4d28-b00f-94dd1e580329" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[389c21f4-02fe-4d94-a641-fa8e92176295]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:03 devstack sudo[111808]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:03 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.info" returned: 0 in 0.722s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.027s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816922853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd743f05-254f-4e12-9579-480b792c1b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:24:59Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:03 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:03 devstack sudo[111816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329
Jun 17 04:25:03 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.812s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:03 devstack sudo[111817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e 1073741824
Jun 17 04:25:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Deleted volume successfully.
Jun 17 04:25:03 devstack sudo[111817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:03 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-104da95b-1123-4fe4-b7bd-7f23d9979769 tempest-VolumeDependencyTests-615554410 None] Create snapshot completed successfully
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1a2a1f36-e2f1-4e32-a964-3333b197ebad tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-701e5790-0554-4274-9154-81ffda803084-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:03 devstack sudo[111812]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" returned: 0 in 0.818s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:03 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:03 devstack sudo[111823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7
Jun 17 04:25:03 devstack sudo[111823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:04 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329" returned: 0 in 0.762s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:04 devstack sudo[111831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329
Jun 17 04:25:04 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:04 devstack sudo[111817]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e 1073741824" returned: 0 in 0.993s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:04 devstack sudo[111823]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" returned: 0 in 0.694s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-quobyte-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7" released by "delete_volume" :: held 1.581s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:04 devstack sudo[111835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e
Jun 17 04:25:04 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Created reservations ['96781b0f-c3e8-424b-a675-e19f09fee39d', '2ee31759-ed9b-49e1-a238-a6aecf18c98f', '968d2987-d2f2-4dff-91b1-a823347a1164', '8276ff3c-9855-4514-b3ae-676f9c8986ad'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Flow 'volume_create_manager' (10b0f632-969e-40e9-b853-a630cf49f4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280c0e27-3a97-4dd5-8fa3-0f77f5e5a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280c0e27-3a97-4dd5-8fa3-0f77f5e5a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1213354917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d2e874-fc8a-4ea6-be22-da150061d5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa659b4c08a45c4a1b41077fa83e0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41a43af8-ebb0-44b6-be7e-857318a2de39,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:05Z,use_quota=True,user_id='a63b36e5369d4bdd9a1844ca55bb7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdcabf-bd06-4076-959c-79e091edbe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdcabf-bd06-4076-959c-79e091edbe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2fa154-345c-413c-b163-6a2757e97f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2fa154-345c-413c-b163-6a2757e97f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51d2e874-fc8a-4ea6-be22-da150061d5d8', 'volume_name': 'volume-51d2e874-fc8a-4ea6-be22-da150061d5d8', 'volume_size': 1, 'snapshot_id': '41a43af8-ebb0-44b6-be7e-857318a2de39'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab14b95-56c8-496d-8e82-e5320f91a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab14b95-56c8-496d-8e82-e5320f91a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16c4c6b-8694-4e17-b598-c9134131384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:04 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Volume 51d2e874-fc8a-4ea6-be22-da150061d5d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51d2e874-fc8a-4ea6-be22-da150061d5d8', 'volume_size': 1, 'snapshot_id': '41a43af8-ebb0-44b6-be7e-857318a2de39'}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:04 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:04 devstack sudo[111838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:04 devstack sudo[111838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-4a740490-105f-4d28-b00f-94dd1e580329" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-quobyte-4a740490-105f-4d28-b00f-94dd1e580329" released by "delete_volume" :: held 1.516s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Created reservations ['1577ccc2-8301-487f-a5af-60bffa62c1e3', '7493d75b-919b-4788-ad56-bff8f39b0c7d', '1a7ab709-8d76-4422-a545-94126fde6eaa', '7028c073-263f-463b-b6ec-6a2c96f53357'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:04 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:04 devstack sudo[111840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:04 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:05 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.462s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39-51d2e874-fc8a-4ea6-be22-da150061d5d8" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39-51d2e874-fc8a-4ea6-be22-da150061d5d8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Creating volume 51d2e874-fc8a-4ea6-be22-da150061d5d8 from snapshot 41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc2d484-bf19-4ebc-ad38-5341456218ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd743f05-254f-4e12-9579-480b792c1b3e', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1db7fe-64ed-488d-9d7f-879107a6bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] snapshot: 41a43af8-ebb0-44b6-be7e-857318a2de39, volume: 51d2e874-fc8a-4ea6-be22-da150061d5d8,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:25:05 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-bd743f05-254f-4e12-9579-480b792c1b3e (bd743f05-254f-4e12-9579-480b792c1b3e): created successfully
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1db7fe-64ed-488d-9d7f-879107a6bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (7613bf01-04b2-4197-8d20-ad9d158a2b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-3c76de67-0ba2-495a-9e58-3594ead2384f tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84293d-d088-4469-9e36-85a1a91ed1a2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:05 devstack sudo[111844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:05 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:05 devstack sudo[111838]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.704s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Deleted volume successfully.
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-5f91bede-a8df-4208-8fd8-1e185fff1f15 tempest-CreateVolumesFromSourceVolumeTest-310817913 None] Lock "cinder-d7f25cca-c28f-4152-8fcf-59c9ac6dd4d7-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:05 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.654s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:05 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Deleted volume successfully.
Jun 17 04:25:05 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-93ba9c99-59d0-4457-aa0f-77502ab33d3f tempest-CinderUnicodeTest-1319514259 None] Lock "cinder-4a740490-105f-4d28-b00f-94dd1e580329-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:06 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.942s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b79820b-9754-438b-8aac-5917b683af76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[29885ba4-1cdb-4268-804a-1578a97053e8]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:06 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:06 devstack sudo[111851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:25:06 devstack sudo[111851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:07 devstack sudo[111851]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 0.874s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:07 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:25:07 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:07 devstack sudo[111856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8
Jun 17 04:25:07 devstack sudo[111856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:12 devstack sudo[111856]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8" returned: 0 in 5.678s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:12 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5565149-995e-4555-9c90-aad945a4d061]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:12 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:12 devstack sudo[111870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:25:12 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:13 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 0.894s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:13 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:25:13 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Converted 1024.00 MB image at 180.29 MB/s
Jun 17 04:25:13 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 is being set with open permissions: ugo+rw
Jun 17 04:25:13 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:13 devstack sudo[111875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8
Jun 17 04:25:13 devstack sudo[111875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:14 devstack sudo[111875]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" released by "_copy_volume_from_snapshot" :: held 9.160s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39-51d2e874-fc8a-4ea6-be22-da150061d5d8" released by "_create_volume_from_snapshot" :: held 9.215s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.237s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.355s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating offline snapshot c211e48a-04ff-494a-839e-8d9d2817c869 of volume bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16c4c6b-8694-4e17-b598-c9134131384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d2e874-fc8a-4ea6-be22-da150061d5d8', 'volume_size': 1, 'snapshot_id': '41a43af8-ebb0-44b6-be7e-857318a2de39'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9f8588-8831-4a4a-b33c-c203cd5d38a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[179b0872-e18b-4bab-acb8-f3a7cb3eaf3b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:14 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Volume volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 (51d2e874-fc8a-4ea6-be22-da150061d5d8): created successfully
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9f8588-8831-4a4a-b33c-c203cd5d38a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Flow 'volume_create_manager' (10b0f632-969e-40e9-b853-a630cf49f4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Flow 'volume_create_manager' (b7e0f1db-a86c-4654-8d11-6a117910a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73fbaf8-8c5e-4bb6-b0cc-8ff5a25b65d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:14 devstack sudo[111878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e
Jun 17 04:25:14 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73fbaf8-8c5e-4bb6-b0cc-8ff5a25b65d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2992a67-e21d-4648-867a-304e4df05198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acba00033449ff9dc86fba81f2c51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:14Z,use_quota=True,user_id='d8d34cf02b3040b58425eef5b0e12c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99e612e-fe8c-43cc-845b-47b231ce8b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99e612e-fe8c-43cc-845b-47b231ce8b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434278eb-a882-46da-b9a1-581ac112ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.image.glance [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Creating Keystone auth plugin from conf {{(pid=92204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-41a43af8-ebb0-44b6-be7e-857318a2de39-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:14 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-8ae043a1-ca49-4700-8e53-dd1ec0f3bc7d tempest-VolumeDependencyTests-615554410 None] Created volume successfully.
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-41a43af8-ebb0-44b6-be7e-857318a2de39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Deleting offline snapshot 41a43af8-ebb0-44b6-be7e-857318a2de39 of volume 0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] snapshot_file for this snap is: volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac70192-05c4-4550-870b-36afdbe8943d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:14 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:15 devstack sudo[111880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:15 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434278eb-a882-46da-b9a1-581ac112ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2992a67-e21d-4648-867a-304e4df05198', 'volume_name': 'volume-d2992a67-e21d-4648-867a-304e4df05198', 'volume_size': 1, 'image_id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba2e33e7c3fdcc8a96952b032f738bcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54acba00033449ff9dc86fba81f2c51a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c867f60b741620bdffc9976d4041870c251ea7a8ad9a1623f769fa07fcbfb9b442c9357dec1e45a361406c9cc3ca9a847bde235728ad2a1a69c72044d6a8a', 'id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'created_at': datetime.datetime(2026, 6, 17, 2, 25, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 25, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b2a9010>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768cc7a9-7871-446d-9931-f8b356e90b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768cc7a9-7871-446d-9931-f8b356e90b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6d5ae8-8d78-4d0c-956a-4dd827222d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:15 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Volume d2992a67-e21d-4648-867a-304e4df05198: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2992a67-e21d-4648-867a-304e4df05198', 'volume_size': 1, 'image_id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba2e33e7c3fdcc8a96952b032f738bcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54acba00033449ff9dc86fba81f2c51a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c867f60b741620bdffc9976d4041870c251ea7a8ad9a1623f769fa07fcbfb9b442c9357dec1e45a361406c9cc3ca9a847bde235728ad2a1a69c72044d6a8a', 'id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'created_at': datetime.datetime(2026, 6, 17, 2, 25, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 25, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b2a9010>}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Trying to clone d2992a67-e21d-4648-867a-304e4df05198 from image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}]). {{(pid=92204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 17 04:25:15 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Image download 0.00 MB at 0.00 MB/s
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e1b077-51b6-47da-a512-6963adbe2ce4]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:15 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e" returned: 0 in 0.860s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:15 devstack sudo[111887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 1G
Jun 17 04:25:15 devstack sudo[111887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:15 devstack sudo[111886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:15 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:15 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.872s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b79820b-9754-438b-8aac-5917b683af76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d07c2-4405-4849-928b-09165430781f]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:15 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:15 devstack sudo[111893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:25:15 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:16 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:16 devstack sudo[111901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:16 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:16 devstack sudo[111887]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 1G" returned: 0 in 1.174s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd743f05-254f-4e12-9579-480b792c1b3e -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:16 devstack sudo[111906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd743f05-254f-4e12-9579-480b792c1b3e -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869
Jun 17 04:25:16 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:16 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 1.046s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:16 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:16 devstack sudo[111909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:16 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:16 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 1 in 0.846s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Temporary image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 is fetched for user d8d34cf02b3040b58425eef5b0e12c74. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[84529d2b-0c7b-4c42-acf5-1f85198b53a9]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:17 devstack sudo[111914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:17 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:17 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd743f05-254f-4e12-9579-480b792c1b3e -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869" returned: 0 in 0.862s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:17 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 is being set with open permissions: ugo+rw
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:17 devstack sudo[111921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869
Jun 17 04:25:17 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:17 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.872s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:17 devstack sudo[111926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39
Jun 17 04:25:17 devstack sudo[111926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:17 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:17 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:18 devstack sudo[111930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:18 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:18 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869" returned: 0 in 0.785s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:18 devstack sudo[111933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info
Jun 17 04:25:18 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:18 devstack sudo[111926]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76.41a43af8-ebb0-44b6-be7e-857318a2de39" returned: 0 in 0.799s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-41a43af8-ebb0-44b6-be7e-857318a2de39" released by "_delete_snapshot" :: held 3.738s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" released by "delete_snapshot" :: held 3.786s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Created reservations ['d05f9b81-15d0-4c0c-ae54-961d3466ba2c', '351cac3e-b0fb-4619-9f4f-fbf8b364212c', '19d21ca0-b268-448f-af44-8dd965da2bbe', 'e4968a79-5a10-4b38-83a5-e94944b1ca96'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:18 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Delete snapshot completed successfully.
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f7f8d04e-9b6b-4322-9c6a-991241536b52 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-41a43af8-ebb0-44b6-be7e-857318a2de39-delete_snapshot" released by "delete_snapshot" :: held 4.028s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:18 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 1 in 0.930s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-0b79820b-9754-438b-8aac-5917b683af76-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:18 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info" returned: 0 in 0.755s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:18 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info is being set with open permissions: ugo+rw
Jun 17 04:25:18 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "cinder-0b79820b-9754-438b-8aac-5917b683af76-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:19 devstack sudo[111940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info
Jun 17 04:25:19 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1de33c-2651-474a-8ed5-bf768872cc7d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:19 devstack sudo[111942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:25:19 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:19 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.info" returned: 0 in 0.593s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.186s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2992a67-e21d-4648-867a-304e4df05198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acba00033449ff9dc86fba81f2c51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:14Z,use_quota=True,user_id='d8d34cf02b3040b58425eef5b0e12c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Creating volume d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:19 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:19 devstack sudo[111945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1073741824
Jun 17 04:25:19 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:19 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f996e619-da1c-4c80-b666-925a888e687c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Create snapshot completed successfully
Jun 17 04:25:19 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 0.823s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:19 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:19 devstack sudo[111950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76
Jun 17 04:25:19 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=148,cinder:UPDATE=168,cinder:INSERT=48,cinder:DELETE=18 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (d58aadd4-c76f-4991-b4c4-0700d7738404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69062c2-8e18-4a1a-8608-c50bcbe0a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69062c2-8e18-4a1a-8608-c50bcbe0a47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314731458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88247c75-2ac7-4e02-ba19-b2448a4f0c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:20Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669bf585-154f-4649-a3c9-88c0acd7306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669bf585-154f-4649-a3c9-88c0acd7306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826160b4-c4da-45ea-961d-1d91152ba4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826160b4-c4da-45ea-961d-1d91152ba4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88247c75-2ac7-4e02-ba19-b2448a4f0c84', 'volume_name': 'volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8703b0-59f8-4888-ad17-aac8ce8e4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8703b0-59f8-4888-ad17-aac8ce8e4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed05913e-2490-4204-9912-000a117f2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume 88247c75-2ac7-4e02-ba19-b2448a4f0c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84', 'volume_size': 1}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:20 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1073741824" returned: 0 in 1.104s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=194,cinder:SELECT=126,cinder:DELETE=16,cinder:INSERT=46 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (e13af7c3-dd9e-432a-bb9c-8933a4321e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4010e73d-1c6a-4ed3-87ea-7c2d07fe824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4010e73d-1c6a-4ed3-87ea-7c2d07fe824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193069868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74b47e9-174d-45a1-abca-7ed4b1584ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:21Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack sudo[111956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:20 devstack sudo[111956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65874e1a-5969-4e40-98e4-bb6d70230126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65874e1a-5969-4e40-98e4-bb6d70230126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c05e8eb-d031-49c6-826c-6022e3f7f61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c05e8eb-d031-49c6-826c-6022e3f7f61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74b47e9-174d-45a1-abca-7ed4b1584ce6', 'volume_name': 'volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29704a5c-be1f-47d2-8879-952905de5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29704a5c-be1f-47d2-8879-952905de5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e036755-3a90-4645-9834-504cf007fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:20 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume f74b47e9-174d-45a1-abca-7ed4b1584ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6', 'volume_size': 1}
Jun 17 04:25:20 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:21 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0b79820b-9754-438b-8aac-5917b683af76" returned: 0 in 1.077s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-0b79820b-9754-438b-8aac-5917b683af76" released by "delete_volume" :: held 1.986s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Created reservations ['b465a26a-7dd3-4cad-948a-f47decea269b', '86a3b55e-3f82-4fa6-ad2c-9da7c73d2b50', '4c18747e-d82d-4c2f-af63-9fbea6ac0a63', '34e53148-e917-442c-9709-b82057fdb704'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:21 devstack sudo[111958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:21 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (d5c90737-7d59-4cd8-ab4f-adf2521264ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6debba30-7d20-4252-9ed9-4ae09014b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6debba30-7d20-4252-9ed9-4ae09014b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624894960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b516474-af99-4f4a-887a-f4656b6a9b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:21Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f723da8a-e7c2-42ff-951f-067737164cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f723da8a-e7c2-42ff-951f-067737164cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5350f22d-b279-4b2f-93eb-30b96f7b65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5350f22d-b279-4b2f-93eb-30b96f7b65e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b516474-af99-4f4a-887a-f4656b6a9b37', 'volume_name': 'volume-9b516474-af99-4f4a-887a-f4656b6a9b37', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6a21d4-3273-410a-91c1-789d9e251807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6a21d4-3273-410a-91c1-789d9e251807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbb5a47-ea71-4b57-852d-e981d55f4794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:21 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume 9b516474-af99-4f4a-887a-f4656b6a9b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b516474-af99-4f4a-887a-f4656b6a9b37', 'volume_size': 1}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:21 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (3f8a9073-524d-4f0c-9e3a-326febce61fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b77b07-880e-42bf-9d5a-efa3876e5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b77b07-880e-42bf-9d5a-efa3876e5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973491607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7069fc-83ac-4462-804f-61bdd9704ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:22Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack sudo[111956]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c99e26-e3ac-4746-adfb-a955f5f9c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c99e26-e3ac-4746-adfb-a955f5f9c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa29b0b-19ae-494c-9894-a70387cc5cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa29b0b-19ae-494c-9894-a70387cc5cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7069fc-83ac-4462-804f-61bdd9704ec1', 'volume_name': 'volume-7c7069fc-83ac-4462-804f-61bdd9704ec1', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc50aefe-a210-4e9b-89f2-1a3b5776ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc50aefe-a210-4e9b-89f2-1a3b5776ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97908227-ec1f-438c-852e-66cf49f02c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume 7c7069fc-83ac-4462-804f-61bdd9704ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7069fc-83ac-4462-804f-61bdd9704ec1', 'volume_size': 1}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 0 in 1.262s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314731458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88247c75-2ac7-4e02-ba19-b2448a4f0c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:20Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume 88247c75-2ac7-4e02-ba19-b2448a4f0c84 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:22 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Attempting download of 8b7a260c-e069-4c43-adb7-488d3f9d7da2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}])) to volume d2992a67-e21d-4648-867a-304e4df05198. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 17 04:25:22 devstack sudo[111961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 1073741824
Jun 17 04:25:22 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[618b33fb-ead9-4ce9-bdd6-d2d4eaa2aa1d]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:22 devstack sudo[112003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t
Jun 17 04:25:22 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-51d2e874-fc8a-4ea6-be22-da150061d5d8-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:22 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.153s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-51d2e874-fc8a-4ea6-be22-da150061d5d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:22 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Deleted volume successfully.
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-72f83c97-e09b-45dc-a3e1-47103bacf87a tempest-VolumeDependencyTests-615554410 None] Lock "cinder-0b79820b-9754-438b-8aac-5917b683af76-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (a6b005ab-f652-46e9-adf1-90fd75cd9caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34271d8-d923-4e19-a21a-c444356084c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34271d8-d923-4e19-a21a-c444356084c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-440331940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ac22f-883e-44ef-9eac-51a1c65f4462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:23Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf51591-281d-4152-b391-68c914c3f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf51591-281d-4152-b391-68c914c3f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3193b4a2-d24c-4702-98a5-05e0eb42a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3193b4a2-d24c-4702-98a5-05e0eb42a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5ac22f-883e-44ef-9eac-51a1c65f4462', 'volume_name': 'volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4497186-b361-4d25-9b29-6c367331efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4497186-b361-4d25-9b29-6c367331efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabaa462-dd78-456b-9bb0-ca88e87a5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:22 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume 0f5ac22f-883e-44ef-9eac-51a1c65f4462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462', 'volume_size': 1}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" acquired by "delete_volume" :: waited 0.061s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef14d6-11b5-417f-bac2-023498baec01]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:22 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:22 devstack sudo[112052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8
Jun 17 04:25:22 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:23 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 1073741824" returned: 0 in 1.027s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:23 devstack sudo[112060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84
Jun 17 04:25:23 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:23 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t" returned: 0 in 0.938s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:23 devstack sudo[112062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t
Jun 17 04:25:23 devstack sudo[112062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:23 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8" returned: 0 in 0.955s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:23 devstack sudo[112067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8
Jun 17 04:25:23 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:23 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84" returned: 0 in 0.732s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.965s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193069868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74b47e9-174d-45a1-abca-7ed4b1584ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:21Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume f74b47e9-174d-45a1-abca-7ed4b1584ce6 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:23 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:23 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:24 devstack sudo[112072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 1073741824
Jun 17 04:25:24 devstack sudo[112072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed05913e-2490-4204-9912-000a117f2067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d04004-bd11-45ab-8585-8e3cc41282a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:24 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 (88247c75-2ac7-4e02-ba19-b2448a4f0c84): created successfully
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d04004-bd11-45ab-8585-8e3cc41282a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (d58aadd4-c76f-4991-b4c4-0700d7738404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:24 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-74dc8819-8968-4777-9528-1c93273ce4cc tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:24 devstack sudo[112062]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t" returned: 1 in 0.835s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b7a260c-e069-4c43-adb7-488d3f9d7da2_lh17pg2t' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90cec3c-7c08-4775-a1cc-a80a7085b11b]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:24 devstack sudo[112074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:24 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:24 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-51d2e874-fc8a-4ea6-be22-da150061d5d8" returned: 0 in 0.952s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-quobyte-51d2e874-fc8a-4ea6-be22-da150061d5d8" released by "delete_volume" :: held 1.968s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Created reservations ['dbf0b8ee-0af8-47bc-9bcd-9c2481fbf72b', '67228934-8ceb-44ec-8fa1-8ca9a90ff5ba', '53ad9c7c-8994-4302-be93-122033fed58d', '6b4ae818-d4c8-4770-a89e-c84298a40ef8'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:24 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:24 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:24 devstack sudo[112083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:24 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:24 devstack sudo[112082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD
Jun 17 04:25:24 devstack sudo[112082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:25 devstack sudo[112072]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 1073741824" returned: 0 in 1.124s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:25 devstack sudo[112086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6
Jun 17 04:25:25 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:25 devstack sudo[112082]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] 8b7a260c-e069-4c43-adb7-488d3f9d7da2 was raw, converting to raw {{(pid=92204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:25 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Deleted volume successfully.
Jun 17 04:25:25 devstack sudo[112092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:25 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a546fe07-9231-41a7-9c87-a59ee308b501 tempest-VolumeDependencyTests-615554410 None] Lock "cinder-51d2e874-fc8a-4ea6-be22-da150061d5d8-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:25 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6" returned: 0 in 0.709s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.189s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624894960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b516474-af99-4f4a-887a-f4656b6a9b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:21Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume 9b516474-af99-4f4a-887a-f4656b6a9b37 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:25 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e036755-3a90-4645-9834-504cf007fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:25 devstack sudo[112095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 1073741824
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5fc8da-1fe9-4968-a844-0c6cf95f00cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:25 devstack sudo[112095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:25 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 (f74b47e9-174d-45a1-abca-7ed4b1584ce6): created successfully
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5fc8da-1fe9-4968-a844-0c6cf95f00cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:25 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (e13af7c3-dd9e-432a-bb9c-8933a4321e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:25 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fcf61a21-d6d5-4c25-986e-3b46169c551a tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:26 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:26 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b7a260c-e069-4c43-adb7-488d3f9d7da2_fdpmv42bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:25:26 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Converted 0.00 MB image at 0.00 MB/s
Jun 17 04:25:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:26 devstack sudo[112102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1G
Jun 17 04:25:26 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:26 devstack sudo[112095]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 1073741824" returned: 0 in 1.008s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:26 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:26 devstack sudo[112107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37
Jun 17 04:25:26 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:27 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 1G" returned: 0 in 0.852s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[079fd77a-96b0-4f54-8e83-5c405d4246b6]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:27 devstack sudo[112112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:27 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:27 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37" returned: 0 in 0.794s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973491607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7069fc-83ac-4462-804f-61bdd9704ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:22Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume 7c7069fc-83ac-4462-804f-61bdd9704ec1 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:27 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbb5a47-ea71-4b57-852d-e981d55f4794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b516474-af99-4f4a-887a-f4656b6a9b37', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:27 devstack sudo[112115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 1073741824
Jun 17 04:25:27 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94967c1e-f88b-4a57-89c1-079c68b5de4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:27 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-9b516474-af99-4f4a-887a-f4656b6a9b37 (9b516474-af99-4f4a-887a-f4656b6a9b37): created successfully
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94967c1e-f88b-4a57-89c1-079c68b5de4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:27 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (d5c90737-7d59-4cd8-ab4f-adf2521264ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:27 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-c0c4b13a-d506-4cc6-96b0-9b1d76e76035 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:28 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 0 in 0.915s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:28 devstack sudo[112119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:28 devstack sudo[112119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:28 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 1073741824" returned: 0 in 0.990s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:28 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:28 devstack sudo[112125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1
Jun 17 04:25:28 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:29 devstack sudo[112119]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 1 in 0.793s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Downloaded image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}])) to volume d2992a67-e21d-4648-867a-304e4df05198 successfully. {{(pid=92204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Temporary image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 for user d8d34cf02b3040b58425eef5b0e12c74 is deleted. {{(pid=92204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.volume_utils [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Marking volume d2992a67-e21d-4648-867a-304e4df05198 as bootable. {{(pid=92204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Copying metadata from image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 to d2992a67-e21d-4648-867a-304e4df05198. {{(pid=92204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Creating volume glance metadata for volume d2992a67-e21d-4648-867a-304e4df05198 backed by image 8b7a260c-e069-4c43-adb7-488d3f9d7da2 with: {'image_id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba2e33e7c3fdcc8a96952b032f738bcc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6d5ae8-8d78-4d0c-956a-4dd827222d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2992a67-e21d-4648-867a-304e4df05198', 'volume_size': 1, 'image_id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba2e33e7c3fdcc8a96952b032f738bcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54acba00033449ff9dc86fba81f2c51a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c867f60b741620bdffc9976d4041870c251ea7a8ad9a1623f769fa07fcbfb9b442c9357dec1e45a361406c9cc3ca9a847bde235728ad2a1a69c72044d6a8a', 'id': '8b7a260c-e069-4c43-adb7-488d3f9d7da2', 'created_at': datetime.datetime(2026, 6, 17, 2, 25, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 25, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b7a260c-e069-4c43-adb7-488d3f9d7da2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x719b4b2a9010>}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909a7c1a-45da-40aa-8a69-6022b4213710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Volume volume-d2992a67-e21d-4648-867a-304e4df05198 (d2992a67-e21d-4648-867a-304e4df05198): created successfully
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909a7c1a-45da-40aa-8a69-6022b4213710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Flow 'volume_create_manager' (b7e0f1db-a86c-4654-8d11-6a117910a665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:29 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-76fc0423-aad1-4a78-96cb-870e6cc11c46 tempest-VolumeImageDependencyTests-312516936 None] Created volume successfully.
Jun 17 04:25:29 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1" returned: 0 in 0.604s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.646s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-440331940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ac22f-883e-44ef-9eac-51a1c65f4462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbb4f14a01946aa9787c22132cd3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:23Z,use_quota=True,user_id='08d37a59e4a0465f8d5bd520aaf28799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Creating volume 0f5ac22f-883e-44ef-9eac-51a1c65f4462 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:29 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97908227-ec1f-438c-852e-66cf49f02c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7069fc-83ac-4462-804f-61bdd9704ec1', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:29 devstack sudo[112131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 1073741824
Jun 17 04:25:29 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ed51dd-8744-4d95-a1b5-283ec797e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:29 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 (7c7069fc-83ac-4462-804f-61bdd9704ec1): created successfully
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ed51dd-8744-4d95-a1b5-283ec797e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:29 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (3f8a9073-524d-4f0c-9e3a-326febce61fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:29 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7c0e2a92-a439-4e9a-84db-07ab4ae7107c tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Acquiring lock "cinder-d2992a67-e21d-4648-867a-304e4df05198-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "cinder-d2992a67-e21d-4648-867a-304e4df05198-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Acquiring lock "cinder-quobyte-d2992a67-e21d-4648-867a-304e4df05198" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "cinder-quobyte-d2992a67-e21d-4648-867a-304e4df05198" acquired by "delete_volume" :: waited 0.025s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[565e2c48-f0c4-4b6d-bb92-b9eff5832a71]: (4, 'raw') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:30 devstack sudo[112137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:30 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:30 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 1073741824" returned: 0 in 1.076s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:30 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:30 devstack sudo[112139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462
Jun 17 04:25:30 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:31 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 0 in 0.804s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:31 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462" returned: 0 in 0.628s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabaa462-dd78-456b-9bb0-ca88e87a5bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:31 devstack sudo[112144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:31 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cbd246-85bb-42e6-a30b-eb87237528bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:31 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Volume volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 (0f5ac22f-883e-44ef-9eac-51a1c65f4462): created successfully
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cbd246-85bb-42e6-a30b-eb87237528bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Flow 'volume_create_manager' (a6b005ab-f652-46e9-adf1-90fd75cd9caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:31 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-99d9a1d3-3ae1-4e65-a0d1-d2ed5022058e tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created volume successfully.
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-0f5ac22f-883e-44ef-9eac-51a1c65f4462-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-0f5ac22f-883e-44ef-9eac-51a1c65f4462-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-0f5ac22f-883e-44ef-9eac-51a1c65f4462" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-0f5ac22f-883e-44ef-9eac-51a1c65f4462" acquired by "delete_volume" :: waited 0.020s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b77eae-5daa-45c3-ace2-58464169e33b]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:31 devstack sudo[112146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462
Jun 17 04:25:31 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:31 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 1 in 0.788s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198' failed. Not Retrying. {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 17 04:25:31 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:31 devstack sudo[112151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198
Jun 17 04:25:31 devstack sudo[112151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:32 devstack sudo[112151]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-d2992a67-e21d-4648-867a-304e4df05198" returned: 0 in 0.694s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "cinder-quobyte-d2992a67-e21d-4648-867a-304e4df05198" released by "delete_volume" :: held 2.360s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:32 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462" returned: 0 in 0.914s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:32 devstack sudo[112159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462
Jun 17 04:25:32 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Created reservations ['bacb8997-7734-4c3f-b690-da21574f6119', 'ad4886fd-1549-43a7-98bf-29f0efc3b2e7', 'cd7ca792-f92a-4953-9280-4efe9ff3c27b', '41575b22-4b7f-4410-93dc-db0832142c0b'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:32 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:32 devstack sudo[112161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:32 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:33 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-0f5ac22f-883e-44ef-9eac-51a1c65f4462" returned: 0 in 0.610s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-0f5ac22f-883e-44ef-9eac-51a1c65f4462" released by "delete_volume" :: held 1.573s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['e77ce980-406d-4b8d-907c-5b35336699d4', '10df3cad-c3e5-4907-81d9-d602786c0705', '94b592ed-4e96-4daf-8728-4ecea9bcf2d8', '58b92bad-dec4-46fa-8e91-8b14eacc6f70'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:33 devstack sudo[112168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:33 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:33 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.739s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:33 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Deleted volume successfully.
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-99a0ab0a-70f6-46a1-8d55-c7708d108cb8 tempest-VolumeImageDependencyTests-312516936 None] Lock "cinder-d2992a67-e21d-4648-867a-304e4df05198-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-7c7069fc-83ac-4462-804f-61bdd9704ec1-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-7c7069fc-83ac-4462-804f-61bdd9704ec1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-7c7069fc-83ac-4462-804f-61bdd9704ec1" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:33 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-7c7069fc-83ac-4462-804f-61bdd9704ec1" acquired by "delete_volume" :: waited 0.034s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce1d72-7012-45d4-9786-9ff0eb5176d2]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:34 devstack sudo[112174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1
Jun 17 04:25:34 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:34 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.783s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:34 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-a15f16c8-fbf3-4b6e-b3d0-be99d4b770e8 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-0f5ac22f-883e-44ef-9eac-51a1c65f4462-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:34 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1" returned: 0 in 0.803s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:34 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:34 devstack sudo[112179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1
Jun 17 04:25:34 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:35 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-7c7069fc-83ac-4462-804f-61bdd9704ec1" returned: 0 in 0.673s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-7c7069fc-83ac-4462-804f-61bdd9704ec1" released by "delete_volume" :: held 1.539s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['96c606e2-a538-43ea-9a46-4c872a2f0601', '13d95171-9e19-4416-a681-590abb53cc6f', 'f5035ef3-e080-423e-b2b1-e5ce11280dd6', '0d2102c8-3bb4-4092-855b-55dfe605d7e2'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:35 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:35 devstack sudo[112182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:35 devstack sudo[112182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-9b516474-af99-4f4a-887a-f4656b6a9b37-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-9b516474-af99-4f4a-887a-f4656b6a9b37-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-9b516474-af99-4f4a-887a-f4656b6a9b37" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-9b516474-af99-4f4a-887a-f4656b6a9b37" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[41646733-5436-4379-a207-123f37b16a4a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:36 devstack sudo[112182]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.834s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:36 devstack sudo[112186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37
Jun 17 04:25:36 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:36 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:36 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-2f734270-38ce-460e-8a71-ba10c9d0d117 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-7c7069fc-83ac-4462-804f-61bdd9704ec1-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:37 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37" returned: 0 in 0.757s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:37 devstack sudo[112192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37
Jun 17 04:25:37 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Flow 'volume_create_manager' (c9c2674b-33fd-474b-96eb-9a8d0d15b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d2ffa7-84d0-41b7-b285-ed318c732b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d2ffa7-84d0-41b7-b285-ed318c732b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528840707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b9bb8f-3878-48a7-ba23-c71426ab2137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed5b190fa9443948b928b65ce6a4aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:37Z,use_quota=True,user_id='8a69eb40999b40eba8d3ef19657f7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ba5143-9793-4faf-b10f-cd8a963bad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ba5143-9793-4faf-b10f-cd8a963bad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4fd13d-33f5-427f-84dd-32377bbc1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4fd13d-33f5-427f-84dd-32377bbc1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b9bb8f-3878-48a7-ba23-c71426ab2137', 'volume_name': 'volume-68b9bb8f-3878-48a7-ba23-c71426ab2137', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e49fe1-79aa-4784-938e-a22d67a3ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e49fe1-79aa-4784-938e-a22d67a3ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb58457-ad19-4082-b048-8aedb01ddbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:37 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Volume 68b9bb8f-3878-48a7-ba23-c71426ab2137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b9bb8f-3878-48a7-ba23-c71426ab2137', 'volume_size': 1}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x719b4c605100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528840707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b9bb8f-3878-48a7-ba23-c71426ab2137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed5b190fa9443948b928b65ce6a4aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:37Z,use_quota=True,user_id='8a69eb40999b40eba8d3ef19657f7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)}" {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Creating volume 68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:37 devstack cinder-volume[92204]: INFO cinder.volume.drivers.remotefs [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] casted to osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 1073741824 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:37 devstack sudo[112194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 1073741824
Jun 17 04:25:37 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:37 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-9b516474-af99-4f4a-887a-f4656b6a9b37" returned: 0 in 0.615s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-9b516474-af99-4f4a-887a-f4656b6a9b37" released by "delete_volume" :: held 1.432s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['9570d512-56aa-4a4a-a64d-33c2f2091f3a', '1338a2ec-9ae8-49aa-b7e5-f13040766228', 'df8d17fd-33cb-4fe2-b9af-97f3003e9c04', '8dfa8e20-bf0f-471b-96c6-9ca5fe2751b7'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:37 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:38 devstack sudo[112197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:38 devstack sudo[112197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:38 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 1073741824" returned: 0 in 0.777s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:38 devstack sudo[112202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:38 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-f74b47e9-174d-45a1-abca-7ed4b1584ce6-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-f74b47e9-174d-45a1-abca-7ed4b1584ce6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:38 devstack sudo[112197]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.627s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-f74b47e9-174d-45a1-abca-7ed4b1584ce6" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:38 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-f74b47e9-174d-45a1-abca-7ed4b1584ce6" acquired by "delete_volume" :: waited 0.026s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-1bf738ee-14f2-4cd4-8c15-7a067d95c985 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-9b516474-af99-4f4a-887a-f4656b6a9b37-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa9cbd4-6bdd-4110-b1a9-d32c8f3a28c5]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:38 devstack sudo[112205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6
Jun 17 04:25:38 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:38 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.663s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'} {{(pid=92204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 17 04:25:38 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb58457-ad19-4082-b048-8aedb01ddbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b9bb8f-3878-48a7-ba23-c71426ab2137', 'volume_size': 1}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb99464b-d0f3-4d8d-b00a-25f50cae152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:39 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Volume volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 (68b9bb8f-3878-48a7-ba23-c71426ab2137): created successfully
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb99464b-d0f3-4d8d-b00a-25f50cae152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Flow 'volume_create_manager' (c9c2674b-33fd-474b-96eb-9a8d0d15b939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:39 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-650dbf32-6cd9-44a2-85b7-9c2808362117 tempest-SnapshotDependencyTests-773818391 None] Created volume successfully.
Jun 17 04:25:39 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6" returned: 0 in 0.736s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:39 devstack sudo[112211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6
Jun 17 04:25:39 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Creating offline snapshot f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 of volume 68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f94e898-997b-4f89-9dfd-b76edb667258]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:39 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:39 devstack sudo[112213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:39 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:40 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-f74b47e9-174d-45a1-abca-7ed4b1584ce6" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-f74b47e9-174d-45a1-abca-7ed4b1584ce6" released by "delete_volume" :: held 1.402s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['5540e3cf-5cca-4c11-962b-ea942f1ab1da', '06c29ff1-2ffe-4c66-b2c2-49eaf8d9f691', 'b2311ed3-948a-4a8f-ae06-998c0668f610', '4f6a6689-4e86-4d07-b04d-8c7ceaad1f53'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:40 devstack sudo[112216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:40 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:40 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 1G {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:40 devstack sudo[112221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 1G
Jun 17 04:25:40 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:40 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.619s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:40 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-88247c75-2ac7-4e02-ba19-b2448a4f0c84-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-7b6548ad-b4d1-40cf-9e50-7f92fedbc7a0 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-f74b47e9-174d-45a1-abca-7ed4b1584ce6-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-88247c75-2ac7-4e02-ba19-b2448a4f0c84-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-88247c75-2ac7-4e02-ba19-b2448a4f0c84" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-88247c75-2ac7-4e02-ba19-b2448a4f0c84" acquired by "delete_volume" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f13426-cfcc-4ce2-919a-d219779331f1]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:40 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:41 devstack sudo[112224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84
Jun 17 04:25:41 devstack sudo[112224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:41 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 1G" returned: 0 in 0.764s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:41 devstack sudo[112230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:41 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:41 devstack sudo[112224]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84" returned: 0 in 0.695s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:41 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:41 devstack sudo[112235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84
Jun 17 04:25:41 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:42 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 -F qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.725s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:42 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 is being set with open permissions: ugo+rw
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:42 devstack sudo[112240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:42 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:42 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-88247c75-2ac7-4e02-ba19-b2448a4f0c84" returned: 0 in 0.601s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-88247c75-2ac7-4e02-ba19-b2448a4f0c84" released by "delete_volume" :: held 1.335s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['9cdddca9-78ce-4508-ad3c-47be4b49e9e6', 'b8fa29de-bccd-450e-bbe0-03aa748c3629', 'b4f0ae75-8233-4719-aae4-b7f8fb82614e', '2dc1e03b-074b-43d6-ab8b-243bfc57c809'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:42 devstack sudo[112243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:42 devstack sudo[112243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:42 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.634s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:42 devstack sudo[112246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info
Jun 17 04:25:42 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:42 devstack sudo[112243]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.589s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:42 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:42 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-f019a674-ac6c-43b4-a1e9-9b1f71a18afe tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-88247c75-2ac7-4e02-ba19-b2448a4f0c84-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-c211e48a-04ff-494a-839e-8d9d2817c869-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-c211e48a-04ff-494a-839e-8d9d2817c869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-c211e48a-04ff-494a-839e-8d9d2817c869" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-c211e48a-04ff-494a-839e-8d9d2817c869" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleting offline snapshot c211e48a-04ff-494a-839e-8d9d2817c869 of volume bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] snapshot_file for this snap is: volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f0ecac-feab-4f62-b7ce-def11372fa5d]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:43 devstack sudo[112249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869
Jun 17 04:25:43 devstack sudo[112249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:43 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info" returned: 0 in 0.661s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:43 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info is being set with open permissions: ugo+rw
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:43 devstack sudo[112252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info
Jun 17 04:25:43 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:43 devstack sudo[112249]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869" returned: 0 in 0.757s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd743f05-254f-4e12-9579-480b792c1b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:25:43 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.info" returned: 0 in 0.614s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.187s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b83f2d-421e-4bbb-a471-a8c036ca9374]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:43 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:44 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-19e92a48-bcc4-469d-a4eb-6325234d6b6d tempest-SnapshotDependencyTests-773818391 None] Create snapshot completed successfully
Jun 17 04:25:44 devstack sudo[112258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e
Jun 17 04:25:44 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:44 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e" returned: 0 in 0.757s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:44 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:44 devstack sudo[112263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869
Jun 17 04:25:44 devstack sudo[112263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:45 devstack sudo[112263]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869" returned: 0 in 0.746s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:45 devstack sudo[112268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869
Jun 17 04:25:45 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Flow 'volume_create_manager' (cd9d50f2-efd4-4e45-9042-7d50c9cf1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034140cc-7288-454a-85aa-2ff43513d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034140cc-7288-454a-85aa-2ff43513d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-17T02:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54becbb-2348-4274-a812-391de990d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed5b190fa9443948b928b65ce6a4aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9c6e47d-7bd1-4d8b-8594-19cc693c16e4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:25:46Z,use_quota=True,user_id='8a69eb40999b40eba8d3ef19657f7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8e23bb-9b6f-40a8-99da-656c04e1f0ff),volume_type_id=2b8e23bb-9b6f-40a8-99da-656c04e1f0ff)' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ca468-dd6d-41d1-8d51-f4fc2db40130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ca468-dd6d-41d1-8d51-f4fc2db40130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f52b1df-5bdc-400b-982e-0da025bf600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f52b1df-5bdc-400b-982e-0da025bf600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c54becbb-2348-4274-a812-391de990d7f0', 'volume_name': 'volume-c54becbb-2348-4274-a812-391de990d7f0', 'volume_size': 1, 'snapshot_id': 'f9c6e47d-7bd1-4d8b-8594-19cc693c16e4'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcf1fa-bd81-4514-865d-782ffe5d417d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcf1fa-bd81-4514-865d-782ffe5d417d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d553fed-eee2-44e4-839f-8d41da68c4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:45 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Volume c54becbb-2348-4274-a812-391de990d7f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c54becbb-2348-4274-a812-391de990d7f0', 'volume_size': 1, 'snapshot_id': 'f9c6e47d-7bd1-4d8b-8594-19cc693c16e4'}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-c54becbb-2348-4274-a812-391de990d7f0" by "_create_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-c54becbb-2348-4274-a812-391de990d7f0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Creating volume c54becbb-2348-4274-a812-391de990d7f0 from snapshot f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Selected osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd as target Quobyte volume. {{(pid=92204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" by "_copy_volume_from_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] snapshot: f9c6e47d-7bd1-4d8b-8594-19cc693c16e4, volume: c54becbb-2348-4274-a812-391de990d7f0,  {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c1e5c6-8503-4d40-9396-6ea670634da9]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:45 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:45 devstack sudo[112270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:45 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:46 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e.c211e48a-04ff-494a-839e-8d9d2817c869" returned: 0 in 0.613s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-c211e48a-04ff-494a-839e-8d9d2817c869" released by "_delete_snapshot" :: held 3.003s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" released by "delete_snapshot" :: held 3.027s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['4d9d4700-cbee-437a-863c-2a4dcad3f0e7', '34b50508-6ed7-472a-bc1a-fce09c33be54', '7b8db5f7-4072-451e-af54-3a4f19064dfd', 'da807163-f005-4566-bf16-45c4f6d5beda'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:46 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Delete snapshot completed successfully.
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-74685d5c-6fda-44e4-b4f3-05f5ef6e455d tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-c211e48a-04ff-494a-839e-8d9d2817c869-delete_snapshot" released by "delete_snapshot" :: held 3.178s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:46 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.723s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b9bb8f-3878-48a7-ba23-c71426ab2137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Creating direct copy from snapshot {{(pid=92204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7acf5cb-bab4-4e63-b796-e4addaadb29c]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:46 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:46 devstack sudo[112277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:46 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:47 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.685s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG cinder.utils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Path /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 not found in is_blk_device check {{(pid=92204) is_blk_device /opt/stack/cinder/cinder/utils.py:621}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:47 devstack sudo[112282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0
Jun 17 04:25:47 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-bd743f05-254f-4e12-9579-480b792c1b3e-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-bd743f05-254f-4e12-9579-480b792c1b3e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" acquired by "delete_volume" :: waited 0.019s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf6a95-84e4-4473-9e6b-8af674e78c7a]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:47 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:47 devstack sudo[112284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e
Jun 17 04:25:47 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:48 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e" returned: 0 in 1.380s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:48 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:48 devstack sudo[112299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e
Jun 17 04:25:48 devstack sudo[112299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:50 devstack sudo[112299]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-bd743f05-254f-4e12-9579-480b792c1b3e" returned: 0 in 1.313s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-quobyte-bd743f05-254f-4e12-9579-480b792c1b3e" released by "delete_volume" :: held 2.788s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Created reservations ['cc6c0ab0-3bee-437a-a850-ded2484b13d6', '3b258cec-a118-498e-b1e1-0f688729a002', 'acf1a7eb-8772-4800-bd98-636ff302fce6', '9c094d8d-47aa-404e-9d72-eb3844ee0282'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:50 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:50 devstack sudo[112302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:50 devstack sudo[112302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:51 devstack sudo[112302]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:51 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 1.245s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:51 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:51 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Deleted volume successfully.
Jun 17 04:25:51 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-bcf3ec1d-725c-4629-a8b2-d100528928c7 tempest-CreateVolumesFromSnapshotTest-2139560160 None] Lock "cinder-bd743f05-254f-4e12-9579-480b792c1b3e-delete_volume" released by "delete_volume" :: held 4.458s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:52 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0" returned: 0 in 4.964s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:52 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c248521-853a-40ab-9417-70a7a7537365]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:52 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:52 devstack sudo[112306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:52 devstack sudo[112306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:53 devstack sudo[112306]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.976s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.image.image_utils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Image conversion details: src /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 {{(pid=92204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 17 04:25:53 devstack cinder-volume[92204]: INFO cinder.image.image_utils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Converted 1024.00 MB image at 206.25 MB/s
Jun 17 04:25:53 devstack cinder-volume[92204]: WARNING cinder.volume.drivers.remotefs [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 is being set with open permissions: ugo+rw
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:53 devstack sudo[112325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0
Jun 17 04:25:53 devstack sudo[112325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:53 devstack sudo[112325]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0" returned: 0 in 0.585s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" released by "_copy_volume_from_snapshot" :: held 8.022s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-c54becbb-2348-4274-a812-391de990d7f0" released by "_create_volume_from_snapshot" :: held 8.057s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.075s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d553fed-eee2-44e4-839f-8d41da68c4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54becbb-2348-4274-a812-391de990d7f0', 'volume_size': 1, 'snapshot_id': 'f9c6e47d-7bd1-4d8b-8594-19cc693c16e4'}' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a5b121-930e-4edb-a128-276f5afd9291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 17 04:25:53 devstack cinder-volume[92204]: INFO cinder.volume.flows.manager.create_volume [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Volume volume-c54becbb-2348-4274-a812-391de990d7f0 (c54becbb-2348-4274-a812-391de990d7f0): created successfully
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a5b121-930e-4edb-a128-276f5afd9291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 17 04:25:53 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Flow 'volume_create_manager' (cd9d50f2-efd4-4e45-9042-7d50c9cf1efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 17 04:25:53 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-4be19f1e-25b2-4093-9592-6028be4f31cd tempest-SnapshotDependencyTests-773818391 None] Created volume successfully.
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-delete_snapshot" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" by "delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" by "_delete_snapshot" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Deleting offline snapshot f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 of volume 68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] snapshot_file for this snap is: volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7824579-0b69-4855-b0c9-c49d9eb60658]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:54 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:54 devstack sudo[112350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:54 devstack sudo[112350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:55 devstack sudo[112350]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.696s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.remotefs [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b9bb8f-3878-48a7-ba23-c71426ab2137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681444a-5d1d-4930-b89a-e2095990dcdf]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:55 devstack sudo[112355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:55 devstack sudo[112355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:55 devstack sudo[112355]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.734s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:55 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:55 devstack sudo[112361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:55 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:56 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.698s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:56 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:56 devstack sudo[112368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4
Jun 17 04:25:56 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:57 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137.f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" returned: 0 in 0.592s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4" released by "_delete_snapshot" :: held 2.814s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" released by "delete_snapshot" :: held 2.836s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Created reservations ['982bc8b0-852b-4869-884f-43823be8beec', '25abf0b4-98f8-4813-b04d-acaf31c5758e', 'f1995ff7-bb36-4bfd-91c1-a8e4e13d7d26', '1be183b3-9e27-4ac5-80b1-43171d8a690f'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:57 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Delete snapshot completed successfully.
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-9d57ea5a-89e1-4fa7-a26b-0dba3fe6f461 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-f9c6e47d-7bd1-4d8b-8594-19cc693c16e4-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-68b9bb8f-3878-48a7-ba23-c71426ab2137-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-68b9bb8f-3878-48a7-ba23-c71426ab2137-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" acquired by "delete_volume" :: waited 0.016s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf917bb-7d04-4a4f-9394-7ee6b5dc2ef6]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:57 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:57 devstack sudo[112371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:57 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:58 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.697s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:58 devstack sudo[112378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137
Jun 17 04:25:58 devstack sudo[112378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:58 devstack sudo[112378]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:58 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-68b9bb8f-3878-48a7-ba23-c71426ab2137" returned: 0 in 0.615s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:58 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-68b9bb8f-3878-48a7-ba23-c71426ab2137" released by "delete_volume" :: held 1.367s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:58 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Created reservations ['7c003229-69bc-4f7c-bb91-6e5a53ab0ba7', 'eaa1ee02-3e1a-4952-8c6b-7faadc2e9249', 'd6954795-285a-4ede-9135-9fc48dbfc5a8', 'ed102ff8-b16a-4da3-b2c8-88e944e85fbd'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:59 devstack sudo[112381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:25:59 devstack sudo[112381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:25:59 devstack sudo[112381]: pam_unix(sudo:session): session closed for user root
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.561s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:25:59 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Deleted volume successfully.
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-fa68be1a-b58c-4292-8d49-a4eda110ba59 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-68b9bb8f-3878-48a7-ba23-c71426ab2137-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-c54becbb-2348-4274-a812-391de990d7f0-delete_volume" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-c54becbb-2348-4274-a812-391de990d7f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" by "delete_volume" {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" acquired by "delete_volume" :: waited 0.014s {{(pid=92204) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb747075-51dd-4b35-a56f-18dbb1daaacf]: (4, 'qcow2') {{(pid=93309) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 17 04:25:59 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:25:59 devstack sudo[112384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0
Jun 17 04:25:59 devstack sudo[112384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:26:00 devstack sudo[112384]: pam_unix(sudo:session): session closed for user root
Jun 17 04:26:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0" returned: 0 in 0.686s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:26:00 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0 {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:26:00 devstack sudo[112389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0
Jun 17 04:26:00 devstack sudo[112389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:26:01 devstack sudo[112389]: pam_unix(sudo:session): session closed for user root
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f/volume-c54becbb-2348-4274-a812-391de990d7f0" returned: 0 in 0.581s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-quobyte-c54becbb-2348-4274-a812-391de990d7f0" released by "delete_volume" :: held 1.308s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.quota [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Created reservations ['f0cd980b-32fc-499d-9860-b5d78be5db2e', '70783781-2310-4ba5-b704-5a012e84c45e', '24ba1e5b-9493-4c04-8274-854b3a74fa48', '6f6b4ad6-1f07-4e6f-bea1-58069569fc69'] {{(pid=92204) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:26:01 devstack sudo[112392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:26:01 devstack sudo[112392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:26:01 devstack sudo[112392]: pam_unix(sudo:session): session closed for user root
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.559s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:26:01 devstack cinder-volume[92204]: INFO cinder.volume.manager [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Deleted volume successfully.
Jun 17 04:26:01 devstack cinder-volume[92204]: DEBUG cinder.coordination [None req-60e9208f-97eb-4336-94ec-ddbb0ed2cdb7 tempest-SnapshotDependencyTests-773818391 None] Lock "cinder-c54becbb-2348-4274-a812-391de990d7f0-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=92204) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd': None} {{(pid=92204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG cinder.volume.drivers.quobyte [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b16e9e6-adf7-44b7-bce8-87ff117fd9cd'] {{(pid=92204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.lockutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 17 04:26:02 devstack sudo[112395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f
Jun 17 04:26:02 devstack sudo[112395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 17 04:26:02 devstack sudo[112395]: pam_unix(sudo:session): session closed for user root
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_concurrency.processutils [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28f97cdb348f739fe99ddb4eb25b7d1f" returned: 0 in 0.594s {{(pid=92204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG cinder.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Notifying Schedulers of capabilities ... {{(pid=92204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG oslo_service.periodic_task [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] Running periodic task VolumeManager._thread_info {{(pid=92204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread count: 28 {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 17 04:26:02 devstack cinder-volume[92204]: DEBUG cinder.volume.manager [None req-a4f265e8-1bc3-4361-b326-757288eb608b None None] thread info: [<_MainThread(MainThread, started 124911918690432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124911810062208)>, <Thread(Thread-3 (stat_writer), started daemon 124911808210304)>, <Thread(Rabbit-heartbeat, started daemon 124911807619008)>, <Thread(Thread-5 (_runner), started daemon 124911807938176)>, <Thread(Thread-7 (_runner), started daemon 124911807986432)>, <Thread(fd_logger, started daemon 124911803999424)>, <Thread(privsep_reader, started daemon 124911803992512)>, <Thread(tpool_thread_0, started daemon 124911794505408)>, <Thread(tpool_thread_1, started daemon 124911786112704)>, <Thread(tpool_thread_2, started daemon 124911777720000)>, <Thread(tpool_thread_3, started daemon 124911769327296)>, <Thread(tpool_thread_4, started daemon 124911760934592)>, <Thread(tpool_thread_5, started daemon 124911752541888)>, <Thread(tpool_thread_6, started daemon 124911744149184)>, <Thread(tpool_thread_7, started daemon 124911735756480)>, <Thread(tpool_thread_8, started daemon 124911727363776)>, <Thread(tpool_thread_9, started daemon 124911718971072)>, <Thread(tpool_thread_10, started daemon 124911710578368)>, <Thread(tpool_thread_11, started daemon 124911702185664)>, <Thread(tpool_thread_12, started daemon 124911693792960)>, <Thread(tpool_thread_13, started daemon 124911685400256)>, <Thread(tpool_thread_14, started daemon 124911677007552)>, <Thread(tpool_thread_15, started daemon 124911668614848)>, <Thread(tpool_thread_16, started daemon 124911660222144)>, <Thread(tpool_thread_17, started daemon 124911651829440)>, <Thread(tpool_thread_18, started daemon 124911643436736)>, <Thread(tpool_thread_19, started daemon 124911635044032)>] {{(pid=92204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 17 04:26:11 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:UPDATE=124,cinder:SELECT=91,cinder:INSERT=34,cinder:DELETE=10 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 17 04:26:11 devstack cinder-volume[92204]: DEBUG dbcounter [-] [92204] Writing DB stats cinder:SELECT=83,cinder:INSERT=34,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=92204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}